-- Logs begin at Thu 2022-09-15 06:48:18 UTC, end at Thu 2022-09-15 07:47:42 UTC. -- Sep 15 07:15:11.969176 dv-cinder-824149-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 07:15:11.978979 dv-cinder-824149-6-smb devstack@keystone.service[81418]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 07:15:11 2022] *** Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: nodename: dv-cinder-824149-6-smb Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: machine: x86_64 Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: clock source: unix Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: pcre jit disabled Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: detected number of CPU cores: 4 Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: current working directory: / Sep 15 07:15:11.981008 dv-cinder-824149-6-smb devstack@keystone.service[81418]: detected binary path: /usr/bin/uwsgi-core Sep 15 07:15:11.981535 dv-cinder-824149-6-smb devstack@keystone.service[81418]: your processes number limit is 47680 Sep 15 07:15:11.981535 dv-cinder-824149-6-smb devstack@keystone.service[81418]: your memory page size is 4096 bytes Sep 15 07:15:11.981535 dv-cinder-824149-6-smb devstack@keystone.service[81418]: detected max file descriptor number: 2048 Sep 15 07:15:11.981535 dv-cinder-824149-6-smb devstack@keystone.service[81418]: lock engine: pthread robust mutexes Sep 15 07:15:11.981535 dv-cinder-824149-6-smb devstack@keystone.service[81418]: thunder lock: enabled Sep 15 07:15:11.981535 dv-cinder-824149-6-smb devstack@keystone.service[81418]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 07:15:11.981535 dv-cinder-824149-6-smb devstack@keystone.service[81418]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 07:15:12.020598 dv-cinder-824149-6-smb devstack@keystone.service[81418]: Python main interpreter initialized at 0x5641169589c0 Sep 15 07:15:12.020598 dv-cinder-824149-6-smb devstack@keystone.service[81418]: python threads support enabled Sep 15 07:15:12.020598 dv-cinder-824149-6-smb devstack@keystone.service[81418]: your server socket listen backlog is limited to 100 connections Sep 15 07:15:12.020598 dv-cinder-824149-6-smb devstack@keystone.service[81418]: your mercy for graceful operations on workers is 90 seconds Sep 15 07:15:12.020954 dv-cinder-824149-6-smb devstack@keystone.service[81418]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 07:15:12.021031 dv-cinder-824149-6-smb devstack@keystone.service[81418]: *** Operational MODE: preforking *** Sep 15 07:15:12.021283 dv-cinder-824149-6-smb devstack@keystone.service[81418]: *** uWSGI is running in multiple interpreter mode *** Sep 15 07:15:12.021283 dv-cinder-824149-6-smb devstack@keystone.service[81418]: spawned uWSGI master process (pid: 81418) Sep 15 07:15:12.021488 dv-cinder-824149-6-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 15 07:15:12.022979 dv-cinder-824149-6-smb devstack@keystone.service[81418]: spawned uWSGI worker 1 (pid: 81430, cores: 1) Sep 15 07:15:12.022979 dv-cinder-824149-6-smb devstack@keystone.service[81418]: spawned uWSGI worker 2 (pid: 81431, cores: 1) Sep 15 07:15:12.022979 dv-cinder-824149-6-smb devstack@keystone.service[81418]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 07:15:16.229093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:15:16.229093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: from cryptography.utils import int_from_bytes Sep 15 07:15:16.229920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:15:16.229920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: from cryptography.utils import int_from_bytes Sep 15 07:15:16.233059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:15:16.233059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: from cryptography.utils import int_from_bytes Sep 15 07:15:16.233564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:15:16.233564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: from cryptography.utils import int_from_bytes Sep 15 07:15:16.279029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 07:15:16.279202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 07:15:16.279352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] command line args: [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 07:15:16.279651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 07:15:16.279782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ================================================================================ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 07:15:16.280060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] admin_token = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.280182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 07:15:16.280274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 07:15:16.280343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config_dir = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.280402 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] command line args: [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 07:15:16.280465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.280612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] config_source = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.280701 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 07:15:16.280833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] debug = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.280975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ================================================================================ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 07:15:16.281057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.282632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] admin_token = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.282632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config_dir = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.282764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.282849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.282913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.282970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] config_source = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] debug = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_config_append = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_dir = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_config_append = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.283992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_dir = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.284959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.285919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.286010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.286238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.286368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.286455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.286705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.286909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.286909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] publish_errors = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287701 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] publish_errors = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.287937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] standard_threads = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288644 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.288976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] standard_threads = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_journal = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_json = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_stderr = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] use_syslog = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.289927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.290035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.290143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_journal = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.290143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_json = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.290360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.290474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_stderr = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.290588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.290697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] use_syslog = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.290697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:15:16.290929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.291940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.292899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.293926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.294799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.295991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.296989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.297986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.298891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.299902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.300958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.301950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.302881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.303917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.304970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.305974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.306988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.307990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.308976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.309987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.310939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.311923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.312951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.313965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.314884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.external = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.external = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.password = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] auth.token = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.315934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.password = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] auth.token = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.316931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317620 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.317949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.318917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319701 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.319929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.320948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.321957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.322879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.323897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.324987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325316 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.325983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.326899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327669 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327780 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.327889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.328889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.329891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.330941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.331957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.332857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.333916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334586 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334701 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.334955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.335964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.336957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.337952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.338908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.339920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.340919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.341917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.342875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.343951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.344991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.345906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.346891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.347909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348719 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.348944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.349941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.350064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.350176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.350286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.350395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.350505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.350647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.350772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.351270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.351392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.351503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.351613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.351723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.351973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352780 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.352890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.353927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.354049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.354275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.354389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.354499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.354638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.354752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.354980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.355097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.355228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.355368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.355482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.355706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.355827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.355939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.356078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.356192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.356402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.356515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.356632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.356826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.356940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.357097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.357209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.357319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.357528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.357644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.357784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.357896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.358056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.358215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.358336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.358514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.358636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.358779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.359998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.360162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.360285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.360452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.360565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.360675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.360909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.361984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.362103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.362291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.362404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.362534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.362648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.362771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.363012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.363126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.363235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.363401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 07:15:16.363514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.363795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.364213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.364620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.365018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.365388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.365757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.366114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.366477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.366890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.367223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.367583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.367940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.368305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.368660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.369027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.369387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.369756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.370106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.370474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.370814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.371207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.371563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:15:16.371811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 07:15:16.392988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.393234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.393422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.402103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.404575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.404803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.405022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.413416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.429977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.430207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.431281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.431510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.483404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.483595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.531263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.531495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.531640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.531790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.689150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.689364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.689571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.689791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.689943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.690024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.690091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.690164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.690326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.690543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.690768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.691010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.713032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.713242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.713459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.713707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.713828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.713899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.713962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.714099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.714194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.714309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.714385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.714522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.714765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.714978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.725397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.725710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.738366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.738498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.738575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.738721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.738803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.738966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739669 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.739958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 07:15:16.756353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.756558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 07:15:16.756906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.757028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.757163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 07:15:16.757263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 07:15:16.757374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.757562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.757699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.757778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 07:15:16.757857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.757981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.758115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.758248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.758510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.758764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.767678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.767969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.768240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.768363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.768515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.768608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.768796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.769072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.775492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.776014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.778377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.778638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.778871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.778966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.779181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.779304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.779458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.779541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.779727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.779850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.779985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.780076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.780228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.780317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.780519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.780644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.780782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.780874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.781057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.781179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.781297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.781586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.803576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.803963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.805040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.805325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.805448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.805674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.809954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.810162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.810260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.810426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.810568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.810847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.816801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.817078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.817202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.817409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.821293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.821579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.821858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.822680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.823000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.823286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.823569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.823806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.823939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.824132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.824271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.824406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.824521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.824634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.824747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.824858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.840008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.840134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.840253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.840334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.844119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.844262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.847343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.847638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.847830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.848235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.852225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.852765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.855506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.855975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.858670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.858996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.859118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.859248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.859332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.859549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.859691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.859828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.859950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.860147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.860271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.860493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.875820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.876107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.876229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.876366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.876446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.876620 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.876743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.876902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.883457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.883586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.884988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.885170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.886511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.886715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.886813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.887004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.889414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.889631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.889730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.889896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.890020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.890161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.890246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.890450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.890589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.890727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.901720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.901844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.901974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.902057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.902285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.902435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.902574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.902655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.902961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.903086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.903241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.903324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.903518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.903642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.918640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.918785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.921640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.921764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.924500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.924624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.925922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.926048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.927450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.927576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.927711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.927793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.927992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.928154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.934472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.934665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.935959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.936227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.938861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.939064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.939224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.939337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.939544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.939691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.939860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.939941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.947594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.947876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.948020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.948109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.948184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.948473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.954967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.955226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 07:15:16.955353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.955565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.955692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.955827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.955920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.956865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.957089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.957233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.957370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.957451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.957599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.957686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.957911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.958037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.958193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.958317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.958436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.958526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.958726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 07:15:16.992787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x5641169589c0 pid: 81431 (default app) Sep 15 07:15:16.993464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x5641169589c0 pid: 81430 (default app) Sep 15 07:15:16.996062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40a66-62ed-4b07-9803-7fd5c6afd8f4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:16.996345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40a66-62ed-4b07-9803-7fd5c6afd8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:16.996617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40a66-62ed-4b07-9803-7fd5c6afd8f4 None None] PATH_INFO: `/v3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:17.000952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Sep 15 07:15:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:23.732332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ea528-6ada-4505-ad5a-69bae3831db1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:23.733135 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ea528-6ada-4505-ad5a-69bae3831db1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:23.733135 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ea528-6ada-4505-ad5a-69bae3831db1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:23.740233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:23.747076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:23.747545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:23.747688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:23.825753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: INFO dbcounter [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] Registered counter for database keystone Sep 15 07:15:23.846703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG oslo_db.sqlalchemy.engines [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:15:23.857891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writer thread running {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:15:24.040847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG passlib.handlers.bcrypt [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81431) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 07:15:24.041151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG passlib.handlers.bcrypt [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81431) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 07:15:24.099536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:24.101502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:24.237582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 07:15:24.732315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ea528-6ada-4505-ad5a-69bae3831db1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:24.802366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: INFO dbcounter [None req-f00ea528-6ada-4505-ad5a-69bae3831db1 None None] Registered counter for database keystone Sep 15 07:15:24.827089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG oslo_db.sqlalchemy.engines [None req-f00ea528-6ada-4505-ad5a-69bae3831db1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:15:24.838993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writer thread running {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:15:24.960877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ea528-6ada-4505-ad5a-69bae3831db1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:24.966291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a840-fb5a-4fa3-ae4a-4534f7ddfae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:24.966952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a840-fb5a-4fa3-ae4a-4534f7ddfae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:24.967231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a840-fb5a-4fa3-ae4a-4534f7ddfae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:24.967499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a840-fb5a-4fa3-ae4a-4534f7ddfae2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:24.976681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a840-fb5a-4fa3-ae4a-4534f7ddfae2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:25.027687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7e28a840-fb5a-4fa3-ae4a-4534f7ddfae2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 07:15:25.028021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a840-fb5a-4fa3-ae4a-4534f7ddfae2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:25.039187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Sep 15 07:15:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:15:25.045715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:25.064604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9ea18-bf55-4322-b674-b284d0aec7b4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:25.070167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbb4ee-b5da-4f86-87a7-89254b486ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:25.071332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb4ee-b5da-4f86-87a7-89254b486ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:25.071608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb4ee-b5da-4f86-87a7-89254b486ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:25.071887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb4ee-b5da-4f86-87a7-89254b486ec4 admin admin] PATH_INFO: `/v3/projects/7faaeb98831242a0b51ad3154e077405` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:25.073558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbb4ee-b5da-4f86-87a7-89254b486ec4 admin admin] RBAC: Authorizing `identity:get_project(project_id=7faaeb98831242a0b51ad3154e077405)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:25.126010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING keystone.common.rbac_enforcer.enforcer [None req-57fbb4ee-b5da-4f86-87a7-89254b486ec4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 07:15:25.126339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbb4ee-b5da-4f86-87a7-89254b486ec4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:25.130953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Sep 15 07:15:25 2022] GET /identity/v3/projects/7faaeb98831242a0b51ad3154e077405 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:27.227528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d34185-6fb9-48fd-ad00-00c7b814cbd1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:27.228119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d34185-6fb9-48fd-ad00-00c7b814cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:27.228119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d34185-6fb9-48fd-ad00-00c7b814cbd1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:27.234641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:27.243916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2440cd-7ba0-460e-aaa3-99ca71605e64 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:27.244318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2440cd-7ba0-460e-aaa3-99ca71605e64 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:27.244524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2440cd-7ba0-460e-aaa3-99ca71605e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:27.270426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9a2440cd-7ba0-460e-aaa3-99ca71605e64 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:27.272070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9a2440cd-7ba0-460e-aaa3-99ca71605e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:27.282692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 07:15:27.547629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d34185-6fb9-48fd-ad00-00c7b814cbd1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:27.563830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d34185-6fb9-48fd-ad00-00c7b814cbd1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:27.569345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77398a-ad20-40a4-896f-9ca2deee62ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:27.569956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77398a-ad20-40a4-896f-9ca2deee62ce admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:27.570217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77398a-ad20-40a4-896f-9ca2deee62ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:27.570513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77398a-ad20-40a4-896f-9ca2deee62ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:27.578281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77398a-ad20-40a4-896f-9ca2deee62ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:27.580159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77398a-ad20-40a4-896f-9ca2deee62ce admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:27.589254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Sep 15 07:15:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 07:15:27.596895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2440cd-7ba0-460e-aaa3-99ca71605e64 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:27.606785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2440cd-7ba0-460e-aaa3-99ca71605e64 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:27.611994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7977ba6-42fb-4ee0-a250-ee660f87b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:27.612634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977ba6-42fb-4ee0-a250-ee660f87b75d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:27.612915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977ba6-42fb-4ee0-a250-ee660f87b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:27.613185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977ba6-42fb-4ee0-a250-ee660f87b75d admin admin] PATH_INFO: `/v3/users/d29816653d6248568ba7209d83b507fb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:27.614664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7977ba6-42fb-4ee0-a250-ee660f87b75d admin admin] RBAC: Authorizing `identity:get_user(user_id=d29816653d6248568ba7209d83b507fb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:27.616558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7977ba6-42fb-4ee0-a250-ee660f87b75d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:27.618099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Sep 15 07:15:27 2022] GET /identity/v3/users/d29816653d6248568ba7209d83b507fb => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:29.813541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ccef4-3aaa-4cbb-8772-54e604b4c32a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:29.814119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ccef4-3aaa-4cbb-8772-54e604b4c32a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:29.814304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ccef4-3aaa-4cbb-8772-54e604b4c32a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:29.815860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:15:29.821466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d63962-4eb0-4185-bf05-af494e8c7e32 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:29.821935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d63962-4eb0-4185-bf05-af494e8c7e32 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:29.822180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d63962-4eb0-4185-bf05-af494e8c7e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:29.826974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1049-4daf-4cd3-8f0d-7771458da168 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:29.827254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1049-4daf-4cd3-8f0d-7771458da168 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:29.827532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1049-4daf-4cd3-8f0d-7771458da168 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:29.828803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:15:29.834693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:29.835026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:29.835302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:29.841940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-04d63962-4eb0-4185-bf05-af494e8c7e32 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:29.843156 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-04d63962-4eb0-4185-bf05-af494e8c7e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:29.877959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG passlib.handlers.bcrypt [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81430) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 07:15:29.878271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG passlib.handlers.bcrypt [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81430) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 07:15:29.926677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:29.928357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:29.929740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:30.030241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:30.205968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d63962-4eb0-4185-bf05-af494e8c7e32 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.233852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:30.298846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.316564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d63962-4eb0-4185-bf05-af494e8c7e32 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.351056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.351714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.351984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.352257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.364123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:30.373049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:30.373953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:30.374788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:30.380289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.397892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98e611-374c-4272-ad83-0fbdf342eba9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.400283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:30.435066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.435948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.436228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.436500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.463477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:30.482846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3109b3-d69e-4f76-b7b9-b5a1d17c929c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.508601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:30.510179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:30.517346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.517983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.518267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.518539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.519259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:30.519566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:30.521128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:30.533063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:30.539019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.608927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 07:15:30.614605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.617761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:30.640821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ceb3d-663c-4785-93ee-211cc8322fd2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.674885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.675533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.675834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.676110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] PATH_INFO: `/v3/users/d29816653d6248568ba7209d83b507fb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.677366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] RBAC: Authorizing `identity:get_user(user_id=d29816653d6248568ba7209d83b507fb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:30.678887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:30.680509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/users/d29816653d6248568ba7209d83b507fb => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:30.686020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.699815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:30.714728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d12f-cb46-41d8-bfe8-041cde83e8fb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.749663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.750514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.750776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.751096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.769191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:30.770740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:30.784454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24139277-905a-415a-94d9-cfb36df33976 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:15:30.788979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:30.789835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:15:30.790630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:15:30.790630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:15:30.790630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:30.790630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:15:30.795962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.820069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.820708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.820981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.821266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.822418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:30.823915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:30.825496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:15:30.831217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:30.851671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:30.896848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1cdb-a3f3-4e2c-b77e-373798a77668 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.909350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:30.928053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9967da9-304b-4e7f-85c9-f1f8d94acba8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:30.930198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359373-cc30-41d5-bf83-f5cb1f8f7d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.930813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359373-cc30-41d5-bf83-f5cb1f8f7d6f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.931120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359373-cc30-41d5-bf83-f5cb1f8f7d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.931391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359373-cc30-41d5-bf83-f5cb1f8f7d6f None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.932037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78359373-cc30-41d5-bf83-f5cb1f8f7d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:30.932333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78359373-cc30-41d5-bf83-f5cb1f8f7d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:30.933722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78359373-cc30-41d5-bf83-f5cb1f8f7d6f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:30.951042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:15:30.961352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f8e0-7907-4ee7-864d-48bf667fcbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:30.961993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f8e0-7907-4ee7-864d-48bf667fcbcf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:30.962270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f8e0-7907-4ee7-864d-48bf667fcbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:30.962540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f8e0-7907-4ee7-864d-48bf667fcbcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:30.963344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f8e0-7907-4ee7-864d-48bf667fcbcf None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.domain.id=default, user.id=d29816653d6248568ba7209d83b507fb) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:30.963647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f8e0-7907-4ee7-864d-48bf667fcbcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:30.965206 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f8e0-7907-4ee7-864d-48bf667fcbcf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:30.972876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Sep 15 07:15:30 2022] GET /identity/v3/role_assignments?user.id=d29816653d6248568ba7209d83b507fb&scope.domain.id=default&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:15:33.478927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aaf54-111f-4d99-89a1-b13dd1f27926 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:33.479442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aaf54-111f-4d99-89a1-b13dd1f27926 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:33.479442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aaf54-111f-4d99-89a1-b13dd1f27926 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:33.480805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:33.497022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572716d-d5c0-4429-aaa9-1f57d46d83dc None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:33.497574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572716d-d5c0-4429-aaa9-1f57d46d83dc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:33.497574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572716d-d5c0-4429-aaa9-1f57d46d83dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:33.527527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7572716d-d5c0-4429-aaa9-1f57d46d83dc None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:33.528754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7572716d-d5c0-4429-aaa9-1f57d46d83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:33.622855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:33.633161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce20b-6b80-4869-9ad5-f6693ba760d2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:33.633446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce20b-6b80-4869-9ad5-f6693ba760d2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:33.633716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce20b-6b80-4869-9ad5-f6693ba760d2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:33.635090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:33.640530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80f60-bb60-4d15-a630-0f466e999b71 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:33.640818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80f60-bb60-4d15-a630-0f466e999b71 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:33.641093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80f60-bb60-4d15-a630-0f466e999b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:33.666142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-59f80f60-bb60-4d15-a630-0f466e999b71 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:33.667358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-59f80f60-bb60-4d15-a630-0f466e999b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:33.763068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:34.019653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961738f-8867-4881-aee7-b3379b878813 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.020311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961738f-8867-4881-aee7-b3379b878813 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.020820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961738f-8867-4881-aee7-b3379b878813 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.022377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 13/26] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:34.028073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6bbf3-5543-4b73-8301-3b2f47563a42 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.028360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6bbf3-5543-4b73-8301-3b2f47563a42 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.028636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6bbf3-5543-4b73-8301-3b2f47563a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.040024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:34.055293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94780de-0e4b-4ce1-975b-373cf97e3010 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.055865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94780de-0e4b-4ce1-975b-373cf97e3010 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.056342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94780de-0e4b-4ce1-975b-373cf97e3010 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.056654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d5a6bbf3-5543-4b73-8301-3b2f47563a42 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:34.057853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d5a6bbf3-5543-4b73-8301-3b2f47563a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:34.058668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:34.063367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a945-86ee-4dcf-b99a-578647be2125 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.063868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a945-86ee-4dcf-b99a-578647be2125 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.064341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a945-86ee-4dcf-b99a-578647be2125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.093556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ffb2a945-86ee-4dcf-b99a-578647be2125 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:34.095112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ffb2a945-86ee-4dcf-b99a-578647be2125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:34.178284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 14/28] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:34.178935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6bbf3-5543-4b73-8301-3b2f47563a42 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:34.195258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 15/29] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:34.241198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2a945-86ee-4dcf-b99a-578647be2125 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:34.291923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:34.348771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6bbf3-5543-4b73-8301-3b2f47563a42 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:34.365378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2a945-86ee-4dcf-b99a-578647be2125 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:34.404552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:34.406249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.407304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.407922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.415490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:34.416385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.419910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.420398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.423099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:34.429516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:34.431041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:34.443568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:34.451656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:34.452509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:34.453265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 15/30] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:15:34.458149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:34.459032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:15:34.459845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:15:34.459845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:15:34.459845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:34.461365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:34.465046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 16/31] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:34.475615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:34.592397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:34.597379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940989a3-4504-4a87-a15b-a253c74b0705 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:34.639891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:34.640521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.640797 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.641071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.641735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:34.642037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:34.644248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:34.659638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e8976-8cd6-4576-bc71-10eecc74ea1b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:34.670349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 17/32] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:34.671302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:34.716992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:34.718157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.719238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.719757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.720582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:34.721033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:34.723754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:34.735925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 16/33] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:34.737752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:34.797972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91ad4-e370-41dc-a573-a668dd06e40a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:34.811801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:34.837229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:34.838131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.838630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.839118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.839981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:34.841609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:34.866921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc884e-7a49-47dd-8445-2e59b65b1377 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:34.902597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:34.903326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:34.903610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:34.903881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:34.904610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:34.906116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:34.985985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 18/34] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 15 07:15:34 2022] POST /identity/v3/roles => generated 225 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:34.987544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:35.015797 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:35.097046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 17/35] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:15:34 2022] POST /identity/v3/projects => generated 301 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:35.098306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:35.104126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e032d-75f0-4825-a16f-701b57fb75d3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:35.151940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c6cb3-e21b-4f7d-bcd5-197461c2be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:35.152735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c6cb3-e21b-4f7d-bcd5-197461c2be45 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.153108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c6cb3-e21b-4f7d-bcd5-197461c2be45 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.153474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c6cb3-e21b-4f7d-bcd5-197461c2be45 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.154379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c6cb3-e21b-4f7d-bcd5-197461c2be45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:35.156313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c6cb3-e21b-4f7d-bcd5-197461c2be45 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:35.177226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 19/36] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 15 07:15:34 2022] POST /identity/v3/roles => generated 219 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:35.179267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffd799-a671-48f1-941e-20d8a690ec5b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.179689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffd799-a671-48f1-941e-20d8a690ec5b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.180051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffd799-a671-48f1-941e-20d8a690ec5b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.181554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 20/37] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:35.187852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79372e-2343-4c27-8cff-c13c4b118c59 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.188213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79372e-2343-4c27-8cff-c13c4b118c59 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.188939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79372e-2343-4c27-8cff-c13c4b118c59 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.190134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 21/38] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:35.192096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12b776-e4a1-47e4-ab4a-e285649b4054 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.192456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12b776-e4a1-47e4-ab4a-e285649b4054 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.192729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12b776-e4a1-47e4-ab4a-e285649b4054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.219618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-da12b776-e4a1-47e4-ab4a-e285649b4054 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:35.221348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-da12b776-e4a1-47e4-ab4a-e285649b4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:35.294667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699490-6a00-4c02-8a0d-763ac2b9770d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:35.305174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 22/39] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:35.312296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0af373-3373-47ee-aeb9-69baf118f501 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.312616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0af373-3373-47ee-aeb9-69baf118f501 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.312849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0af373-3373-47ee-aeb9-69baf118f501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.313612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:35.355301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8a0af373-3373-47ee-aeb9-69baf118f501 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:35.356538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8a0af373-3373-47ee-aeb9-69baf118f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:35.357858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:35.359143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:35.359971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.360276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.360606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] PATH_INFO: `/v3/users/d29816653d6248568ba7209d83b507fb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.362251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] RBAC: Authorizing `identity:get_user(user_id=d29816653d6248568ba7209d83b507fb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:35.371846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:35.374359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 18/40] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:35 2022] GET /identity/v3/users/d29816653d6248568ba7209d83b507fb => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:35.380762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:35.460062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 23/41] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:35.501725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae0e93-b6f2-468c-9939-d62569bc1228 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:35.537611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:35.538308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.538589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.538890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.540111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:35.541578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:35.543205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 19/42] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:15:35.548990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0af373-3373-47ee-aeb9-69baf118f501 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:35.654272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:35.655207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0af373-3373-47ee-aeb9-69baf118f501 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:35.694323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:35.695058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.695340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.695612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] PATH_INFO: `/v3/domains/default/users/d29816653d6248568ba7209d83b507fb/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.698141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d29816653d6248568ba7209d83b507fb, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:35.699738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:35.713319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:35.726847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 24/43] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Sep 15 07:15:35 2022] PUT /identity/v3/domains/default/users/d29816653d6248568ba7209d83b507fb/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:15:35.735978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:35.816335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:35.849993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe24a7-f447-411c-817a-66544b971e6a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:35.877146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece63af-3734-40e5-b390-5523a333861e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:35.890861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:35.891499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.891783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.892054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.892748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:35.894153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:35.912405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 25/44] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 15 07:15:35 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:15:35.921126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad5fb1-9a74-48c4-9dea-29d120683ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:35.921840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5fb1-9a74-48c4-9dea-29d120683ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:35.922117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5fb1-9a74-48c4-9dea-29d120683ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:35.922390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5fb1-9a74-48c4-9dea-29d120683ef5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:35.923847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad5fb1-9a74-48c4-9dea-29d120683ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:35.925462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad5fb1-9a74-48c4-9dea-29d120683ef5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:35.927688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 20/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:15:35.934148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:36.003895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:36.053244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343628a0-b6e4-40a8-a14a-cb18eb9761a5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:36.090943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17b69a-65d9-4368-9f71-ae5354fc042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:36.091629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17b69a-65d9-4368-9f71-ae5354fc042c None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:36.091921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17b69a-65d9-4368-9f71-ae5354fc042c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:36.092194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17b69a-65d9-4368-9f71-ae5354fc042c None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:36.092867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17b69a-65d9-4368-9f71-ae5354fc042c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:36.094385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17b69a-65d9-4368-9f71-ae5354fc042c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:36.125837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 26/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:15:35 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:37.865467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe41576-e63f-4732-b59a-e900d2fa6ddc None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:37.866023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe41576-e63f-4732-b59a-e900d2fa6ddc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:37.866023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe41576-e63f-4732-b59a-e900d2fa6ddc None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:37.867458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 21/47] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:37.872827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbaa04-e5db-43ff-9dd1-2a3daeb86003 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:37.873283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbaa04-e5db-43ff-9dd1-2a3daeb86003 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:37.873363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbaa04-e5db-43ff-9dd1-2a3daeb86003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:37.892767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-aafbaa04-e5db-43ff-9dd1-2a3daeb86003 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:37.893864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-aafbaa04-e5db-43ff-9dd1-2a3daeb86003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:37.963089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 27/48] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:38.224458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe41576-e63f-4732-b59a-e900d2fa6ddc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:38.237133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b647-5806-4c17-b3cb-cde9c004b797 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.237388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b647-5806-4c17-b3cb-cde9c004b797 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.237682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b647-5806-4c17-b3cb-cde9c004b797 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.239109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 28/49] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:15:38.244611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31edfd-e754-484d-a7a1-a7d517e484bd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.244893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31edfd-e754-484d-a7a1-a7d517e484bd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.245174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31edfd-e754-484d-a7a1-a7d517e484bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7c31edfd-e754-484d-a7a1-a7d517e484bd None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:38.269092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7c31edfd-e754-484d-a7a1-a7d517e484bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:38.310229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:38.341836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe41576-e63f-4732-b59a-e900d2fa6ddc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:38.344802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 29/50] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:38.355430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:38.376174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:38.376815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.377096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.377369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.387605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:38.392517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:38.393363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:38.394097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 22/51] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:38.399693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31edfd-e754-484d-a7a1-a7d517e484bd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:38.497491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31edfd-e754-484d-a7a1-a7d517e484bd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:38.531941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:38.532544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.532822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.533091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.533745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:38.534042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:38.535454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:38.551926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 30/52] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:38.558365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:38.607053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:38.672545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531dc9-93cd-4429-8f2e-f6e7b5a623db None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:38.710849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:38.711510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.711787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.712058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] PATH_INFO: `/v3/users/d29816653d6248568ba7209d83b507fb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.713263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] RBAC: Authorizing `identity:get_user(user_id=d29816653d6248568ba7209d83b507fb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:38.714747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:38.716390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 23/53] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:38 2022] GET /identity/v3/users/d29816653d6248568ba7209d83b507fb => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:38.722063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:38.746362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:38.765196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:38.814562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36646-8f07-473d-b436-f1e23a46232f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:38.821701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeebed8-a85d-451b-94f4-759566a0d092 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:38.848948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:38.849571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.849840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.850486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.851675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:38.853136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:38.854721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 31/54] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:38.857117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:38.857820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.858162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.858499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.859751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:38.860231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:38.861215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:38.862776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 24/55] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:38.868452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:38.952859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:38.955694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915744-800c-4e3e-9f5f-776e2bea4389 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:38.965052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478c17-64fa-4332-8f24-1595240416a1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:38.974307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:38.988728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b505d52-1a2f-4c7e-abf9-3456b327841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:38.989440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b505d52-1a2f-4c7e-abf9-3456b327841f None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.989721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b505d52-1a2f-4c7e-abf9-3456b327841f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:38.989990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b505d52-1a2f-4c7e-abf9-3456b327841f None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:38.990651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b505d52-1a2f-4c7e-abf9-3456b327841f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:38.992132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b505d52-1a2f-4c7e-abf9-3456b327841f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:38.999076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c66bf0-7eca-4e73-af79-1d3d8854b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:38.999689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66bf0-7eca-4e73-af79-1d3d8854b7fe None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:38.999970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66bf0-7eca-4e73-af79-1d3d8854b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:39.000244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66bf0-7eca-4e73-af79-1d3d8854b7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:39.000973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c66bf0-7eca-4e73-af79-1d3d8854b7fe None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.domain.id=default, user.id=d29816653d6248568ba7209d83b507fb) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:39.001279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c66bf0-7eca-4e73-af79-1d3d8854b7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:39.002726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c66bf0-7eca-4e73-af79-1d3d8854b7fe None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:39.008740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 25/56] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Sep 15 07:15:38 2022] GET /identity/v3/role_assignments?user.id=d29816653d6248568ba7209d83b507fb&scope.domain.id=default&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:39.018268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 32/57] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Sep 15 07:15:38 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:41.159755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cffbd-2e3d-4498-946f-723e6c299a3f None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:41.160284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cffbd-2e3d-4498-946f-723e6c299a3f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:41.160284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cffbd-2e3d-4498-946f-723e6c299a3f None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:41.161679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 26/58] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:41.168236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf915-be16-431e-ac98-3571c0f697fa None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:41.168935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf915-be16-431e-ac98-3571c0f697fa None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:41.169086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf915-be16-431e-ac98-3571c0f697fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:41.191687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ce5bf915-be16-431e-ac98-3571c0f697fa None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:41.192948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ce5bf915-be16-431e-ac98-3571c0f697fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:41.262765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 33/59] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:41.539278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cffbd-2e3d-4498-946f-723e6c299a3f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:41.672868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cffbd-2e3d-4498-946f-723e6c299a3f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:41.713240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511409-c4f9-451d-84e2-c067a925cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:41.713881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511409-c4f9-451d-84e2-c067a925cd0d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:41.714164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511409-c4f9-451d-84e2-c067a925cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:41.714437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511409-c4f9-451d-84e2-c067a925cd0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:41.715742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511409-c4f9-451d-84e2-c067a925cd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:41.717235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511409-c4f9-451d-84e2-c067a925cd0d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:41.718836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 27/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:41.728418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf915-be16-431e-ac98-3571c0f697fa None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:41.819110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:41.837648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf915-be16-431e-ac98-3571c0f697fa None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:41.874362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92bcb-7454-4d1f-989b-375ff51a9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:41.875332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92bcb-7454-4d1f-989b-375ff51a9b36 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:41.875778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92bcb-7454-4d1f-989b-375ff51a9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:41.876191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92bcb-7454-4d1f-989b-375ff51a9b36 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:41.877228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92bcb-7454-4d1f-989b-375ff51a9b36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:41.879651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92bcb-7454-4d1f-989b-375ff51a9b36 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:41.915663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 34/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:15:41 2022] POST /identity/v3/users => generated 275 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:45.279672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a82e2-9b3a-447a-880c-7ff5c655deb6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.280215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a82e2-9b3a-447a-880c-7ff5c655deb6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.280215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a82e2-9b3a-447a-880c-7ff5c655deb6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.281595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 28/62] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:45.296925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc45b-a252-499d-96e8-72224091444e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.297415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc45b-a252-499d-96e8-72224091444e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.297486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc45b-a252-499d-96e8-72224091444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.320397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324911-dad6-4d75-a96e-6a662211917b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.320989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324911-dad6-4d75-a96e-6a662211917b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.321437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324911-dad6-4d75-a96e-6a662211917b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.323051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 29/63] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:15:45.324298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c0ffc45b-a252-499d-96e8-72224091444e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:45.325471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c0ffc45b-a252-499d-96e8-72224091444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:45.328816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ff1a-2f58-4fd8-aea3-95ec3302531c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.329129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ff1a-2f58-4fd8-aea3-95ec3302531c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.329375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ff1a-2f58-4fd8-aea3-95ec3302531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.354558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4381ff1a-2f58-4fd8-aea3-95ec3302531c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:45.356442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4381ff1a-2f58-4fd8-aea3-95ec3302531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:45.393360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:45.424641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 35/64] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:45.426237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24f90-4db5-4df0-8d98-95201aed7378 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.426724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24f90-4db5-4df0-8d98-95201aed7378 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.427319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24f90-4db5-4df0-8d98-95201aed7378 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.429090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 36/65] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:45.434880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213583b-3dbb-45d2-9d40-225d0e593e9b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.434880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213583b-3dbb-45d2-9d40-225d0e593e9b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.435066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213583b-3dbb-45d2-9d40-225d0e593e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.462077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0213583b-3dbb-45d2-9d40-225d0e593e9b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:45.463303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0213583b-3dbb-45d2-9d40-225d0e593e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:45.466853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 30/66] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:45.567438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:45.576360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 37/67] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:45.728558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381ff1a-2f58-4fd8-aea3-95ec3302531c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:45.754445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc4d9-8dcf-4821-9df7-c3680eb2e649 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.755225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc4d9-8dcf-4821-9df7-c3680eb2e649 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.755699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc4d9-8dcf-4821-9df7-c3680eb2e649 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.757295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 38/68] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:45.763121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e270-dc4c-4361-a3c3-33262ef69f36 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.763652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e270-dc4c-4361-a3c3-33262ef69f36 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.764154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e270-dc4c-4361-a3c3-33262ef69f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.793163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-20d1e270-dc4c-4361-a3c3-33262ef69f36 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:45.794726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-20d1e270-dc4c-4361-a3c3-33262ef69f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:45.871132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381ff1a-2f58-4fd8-aea3-95ec3302531c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:45.881598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 39/69] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:45.886857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e270-dc4c-4361-a3c3-33262ef69f36 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:45.931784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:45.932703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:45.932979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:45.933250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:45.947988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:45.954292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:45.955193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:45.955949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:45.957136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 31/70] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:45.957136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:45.992808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e270-dc4c-4361-a3c3-33262ef69f36 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:45.993955 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.023373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.032176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fabf8c-806b-4072-99b0-47d4294f8ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.032823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabf8c-806b-4072-99b0-47d4294f8ccc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.033106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabf8c-806b-4072-99b0-47d4294f8ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.033380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabf8c-806b-4072-99b0-47d4294f8ccc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.045093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fabf8c-806b-4072-99b0-47d4294f8ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e3fabf8c-806b-4072-99b0-47d4294f8ccc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:46.051532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:46.052515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:46.053262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 40/71] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:46.053869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2069089-1fcd-479a-9675-e06292b12326 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.054307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2069089-1fcd-479a-9675-e06292b12326 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.054404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2069089-1fcd-479a-9675-e06292b12326 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.055649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 41/72] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:46.056330 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2069089-1fcd-479a-9675-e06292b12326 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.075601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10242b8-ddcf-4a87-a29d-4179e157735e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.113662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.114321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.114881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.114982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.125763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:46.131274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:46.132380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:46.133154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 32/73] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:15:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:46.133763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.177592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2069089-1fcd-479a-9675-e06292b12326 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.212334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba11d49-12a4-4e2b-a1f9-4b18672869d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.212951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11d49-12a4-4e2b-a1f9-4b18672869d3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.213239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11d49-12a4-4e2b-a1f9-4b18672869d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.213512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11d49-12a4-4e2b-a1f9-4b18672869d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.214187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11d49-12a4-4e2b-a1f9-4b18672869d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:46.214493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11d49-12a4-4e2b-a1f9-4b18672869d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.215941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11d49-12a4-4e2b-a1f9-4b18672869d3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.224312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 42/74] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.225816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329c9a-0592-426d-ad23-1dd6f6e17c2b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.226100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329c9a-0592-426d-ad23-1dd6f6e17c2b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.226403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329c9a-0592-426d-ad23-1dd6f6e17c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.232341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.242979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f570728-f435-41b8-90c2-a1b24e992048 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.245047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1e329c9a-0592-426d-ad23-1dd6f6e17c2b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:46.246252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1e329c9a-0592-426d-ad23-1dd6f6e17c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:46.279331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.280151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.280699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.280699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.281353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:46.281663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.283151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.291421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 33/75] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.292146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.292540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.316786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 43/76] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:46.317639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e329c9a-0592-426d-ad23-1dd6f6e17c2b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.403492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83f12a-8c17-4528-9311-0f2c56380db6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.421064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e329c9a-0592-426d-ad23-1dd6f6e17c2b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.436374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.437217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.437504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.437787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.438459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:46.438754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.440226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.453055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 34/77] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.453055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.461439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.462096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.462377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.462724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.465768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.474458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:46.479782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:46.480623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:46.481401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 44/78] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:46.482676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.527110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.559148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e9488-85b2-4e80-96d7-7d5be8b26666 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.587222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a93ad6-d61f-4bdb-9b2a-fe342478681b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.596908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.597566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.597859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.598137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] PATH_INFO: `/v3/users/d29816653d6248568ba7209d83b507fb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.599401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] RBAC: Authorizing `identity:get_user(user_id=d29816653d6248568ba7209d83b507fb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.601255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.602889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 35/79] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/users/d29816653d6248568ba7209d83b507fb => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.603650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.621278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.622234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.622725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.623207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.638893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.640388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.642053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 45/80] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.643148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.689067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.707280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2328c03-bd0a-4380-975a-3e5491ee8092 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.737597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.741385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.741652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb50f-8615-478b-9ca2-1cb95e3b8edb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.742029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.742312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.742585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.743777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.745236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.746812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 36/81] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.747607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.778467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.779115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.779397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.779673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.780346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:46.780656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.782049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.790010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 46/82] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.794760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.848000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed1da6-2e34-45d3-8bb7-cfc92690846d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.880656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.881296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.881572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.881846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.883004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.884462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.886077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 37/83] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:46.886952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb2338-4619-4aa3-aadd-3c65810b96da None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:46.887026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:46.909245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.919401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:46.920017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:46.920296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:46.920561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:46.946792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:46.988450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:46.990038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:46.990600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255adb36-d3bd-471d-ad45-bbabaaab0f04 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.024441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.025057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.025333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.025602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.088347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 47/84] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:15:47.089182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.091938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.093687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.111543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.146806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.187987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c5d8-e287-4170-931a-102491029ef8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.195674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 38/85] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:15:47.196716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.226087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.226636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.226949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.227247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.294522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.296070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.297710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4c0ff-b436-4e01-ab34-d45e47febb10 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.314686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.331789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.332430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.332711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.332986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.334122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.335633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.337233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 39/86] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:47.337972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.357564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.400300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 48/87] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:15:47.401305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.439647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc93b4-3351-437e-8f1e-522b6bfbccdd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.473809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.474459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.474746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.475386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.476043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.477571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.499304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96518fb-6ca4-4d99-8767-d6ac2945095f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.518856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 40/88] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:15:47 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:47.518856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.538188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.538874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.539162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.539436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.540861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.542359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.544312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 49/89] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:47.545101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.573753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.583055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.644708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9944f93-9541-4e04-9efe-3c3962162595 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.670454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf647cd-51f1-4be7-9eae-ea32420b5fed None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.681106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.681990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.682105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.682301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.683479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.685563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.686854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 41/90] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:47.687478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.719221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.719883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.720168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.720437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.799843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.802429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.809474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d845d7a-4143-4905-9cfd-ef0d1a666a1a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:47.821277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.838057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:47.851823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:47.852753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:47.853207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:47.853659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:47.855464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:47.857204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:47.859575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 42/91] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:47.860544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.915840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 50/92] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:15:47.916703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:47.969748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495f363-6b46-4971-9831-4c2fde768f8d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:48.008361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:48.009299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:48.009747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:48.010246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:48.011346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=d29816653d6248568ba7209d83b507fb) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:48.011826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:48.013501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:48.020003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 43/93] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/role_assignments?user.id=d29816653d6248568ba7209d83b507fb&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:48.021211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:48.030373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39c99-8ca4-4856-bbc8-ea5e420c627e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:48.067908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:48.074967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:48.086942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:48.087595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:48.087878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:48.088150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:48.089010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=d0e577d4147e404ca97862a7fb601d97) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:48.089222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:48.090716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:48.106111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 51/94] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:15:47 2022] GET /identity/v3/role_assignments?user.id=d0e577d4147e404ca97862a7fb601d97&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:48.118876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:48.188562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a703c-0f01-44b7-bfcb-6ffea32ffe9b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:48.263881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:48.264537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:48.264816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:48.265084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:48.265840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] RBAC: Adding query filter params (role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=d0e577d4147e404ca97862a7fb601d97) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:48.266151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:48.267677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:48.279912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 44/95] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:15:48 2022] GET /identity/v3/role_assignments?user.id=d0e577d4147e404ca97862a7fb601d97&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:48.306151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac671bdc-6395-4b21-a1d7-29f3e4f6a308 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:48.348397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57605b58-53ad-4aea-bfae-8f68e12c86ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:48.349030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57605b58-53ad-4aea-bfae-8f68e12c86ce None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:48.349313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57605b58-53ad-4aea-bfae-8f68e12c86ce None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:48.349588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57605b58-53ad-4aea-bfae-8f68e12c86ce None admin] PATH_INFO: `/v3/projects/bb05c9170fdc45f2b79d39e0783fc009` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:48.351472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57605b58-53ad-4aea-bfae-8f68e12c86ce None admin] RBAC: Authorizing `identity:get_project(project_id=bb05c9170fdc45f2b79d39e0783fc009)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:48.352989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57605b58-53ad-4aea-bfae-8f68e12c86ce None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:48.354992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 52/96] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:48 2022] GET /identity/v3/projects/bb05c9170fdc45f2b79d39e0783fc009 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:48.361682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:48.493300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b2832-61bf-4429-8b79-33ffbf467c0d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:48.503975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:48.536990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08262e7-08c4-4d16-846e-bd34bef38471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:48.537646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08262e7-08c4-4d16-846e-bd34bef38471 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:48.537913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08262e7-08c4-4d16-846e-bd34bef38471 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:48.538187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08262e7-08c4-4d16-846e-bd34bef38471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:48.539001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08262e7-08c4-4d16-846e-bd34bef38471 None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=bb05c9170fdc45f2b79d39e0783fc009, user.id=d0e577d4147e404ca97862a7fb601d97) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:48.539314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08262e7-08c4-4d16-846e-bd34bef38471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:48.540846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08262e7-08c4-4d16-846e-bd34bef38471 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:48.546974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 45/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:15:48 2022] GET /identity/v3/role_assignments?user.id=d0e577d4147e404ca97862a7fb601d97&scope.project.id=bb05c9170fdc45f2b79d39e0783fc009&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:50.128207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e1b7-81ce-4fcb-af84-04756b273734 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:50.128781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e1b7-81ce-4fcb-af84-04756b273734 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:50.128781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e1b7-81ce-4fcb-af84-04756b273734 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:50.130214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 53/98] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:50.142389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273945-1c40-497a-9695-b5c9c9cb0370 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:50.142886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273945-1c40-497a-9695-b5c9c9cb0370 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:50.142981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273945-1c40-497a-9695-b5c9c9cb0370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:50.166306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-32273945-1c40-497a-9695-b5c9c9cb0370 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:50.167542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-32273945-1c40-497a-9695-b5c9c9cb0370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:50.252871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 46/99] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:50.740447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e1b7-81ce-4fcb-af84-04756b273734 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:50.816353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:50.859865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e1b7-81ce-4fcb-af84-04756b273734 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:50.898866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:50.899434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:50.899715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:50.899989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:50.916490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:50.921429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:50.922294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:50.923483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 54/100] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:50.928811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273945-1c40-497a-9695-b5c9c9cb0370 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:51.050757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:51.054054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273945-1c40-497a-9695-b5c9c9cb0370 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:51.091671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:51.092293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.092570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.092841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.093512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:51.093811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:51.095233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:51.104471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 47/101] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:51.110477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:51.235058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417f997-983a-4744-8b9c-cf466c0d6093 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:51.255679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:51.271131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a83f1b-3fdf-4fbf-9ee0-bf63838e9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:51.271770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a83f1b-3fdf-4fbf-9ee0-bf63838e9424 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.272048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a83f1b-3fdf-4fbf-9ee0-bf63838e9424 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.272317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a83f1b-3fdf-4fbf-9ee0-bf63838e9424 None admin] PATH_INFO: `/v3/users/8e6ed3e95e9c4646b813f7eafae524b9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.286500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a83f1b-3fdf-4fbf-9ee0-bf63838e9424 None admin] RBAC: Authorizing `identity:get_user(user_id=8e6ed3e95e9c4646b813f7eafae524b9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:51.288018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a83f1b-3fdf-4fbf-9ee0-bf63838e9424 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:51.290031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 55/102] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:51 2022] GET /identity/v3/users/8e6ed3e95e9c4646b813f7eafae524b9 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:51.295722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:51.323782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2cf63-a6a1-433d-8f7b-a8ef71a39ace None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.324460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2cf63-a6a1-433d-8f7b-a8ef71a39ace None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.324922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2cf63-a6a1-433d-8f7b-a8ef71a39ace None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.326475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 56/103] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:15:51.336292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399799-877c-41ab-b459-d529b193ceb1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.336880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399799-877c-41ab-b459-d529b193ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.337339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399799-877c-41ab-b459-d529b193ceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.367930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5b399799-877c-41ab-b459-d529b193ceb1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:51.369603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5b399799-877c-41ab-b459-d529b193ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:51.467126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee1899-13dd-4f3b-94f8-0bf690b8e30e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:51.481040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 57/104] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:51.483442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03688-26ac-4d7b-a250-3cc9ce7fed79 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.484061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03688-26ac-4d7b-a250-3cc9ce7fed79 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.484569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03688-26ac-4d7b-a250-3cc9ce7fed79 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.486165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 58/105] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:51.487453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb8a9-f144-4568-887f-6fabc055fc7b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.492111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb8a9-f144-4568-887f-6fabc055fc7b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.492589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb8a9-f144-4568-887f-6fabc055fc7b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.495143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 59/106] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:51.496986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ca1a3-9cc2-4df0-bf8b-fb1f7453e3be None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.497496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ca1a3-9cc2-4df0-bf8b-fb1f7453e3be None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.498061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ca1a3-9cc2-4df0-bf8b-fb1f7453e3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.508494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90233e-298d-47dd-997a-66fdce3ed59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:51.509499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90233e-298d-47dd-997a-66fdce3ed59c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.510006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90233e-298d-47dd-997a-66fdce3ed59c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.510474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90233e-298d-47dd-997a-66fdce3ed59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.520837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c28ca1a3-9cc2-4df0-bf8b-fb1f7453e3be None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:51.522293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c28ca1a3-9cc2-4df0-bf8b-fb1f7453e3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:51.571146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:51.637024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90233e-298d-47dd-997a-66fdce3ed59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:51.638674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90233e-298d-47dd-997a-66fdce3ed59c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:51.642588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 60/107] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:51.644253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d3049-1053-4c7d-9746-6dbe4671afce None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.644741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d3049-1053-4c7d-9746-6dbe4671afce None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.645238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d3049-1053-4c7d-9746-6dbe4671afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.663737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7a1d3049-1053-4c7d-9746-6dbe4671afce None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:51.665276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7a1d3049-1053-4c7d-9746-6dbe4671afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:51.719141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:51.785833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 61/108] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:51.787062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66f9e-ab96-4445-9d9c-d8178dbb59e1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.787352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66f9e-ab96-4445-9d9c-d8178dbb59e1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.787628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66f9e-ab96-4445-9d9c-d8178dbb59e1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.788977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 62/109] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:51.799699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c66f9e-ab96-4445-9d9c-d8178dbb59e1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:51.810935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 48/110] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:15:51.812687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e39e-0024-4f9f-9aa2-edf1c84aafb2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:51.814911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e39e-0024-4f9f-9aa2-edf1c84aafb2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:51.815391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e39e-0024-4f9f-9aa2-edf1c84aafb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:51.847638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f888e39e-0024-4f9f-9aa2-edf1c84aafb2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:51.851195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f888e39e-0024-4f9f-9aa2-edf1c84aafb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:51.971910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c66f9e-ab96-4445-9d9c-d8178dbb59e1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:51.975430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:51.988023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 49/111] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:51.989374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e39e-0024-4f9f-9aa2-edf1c84aafb2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.012182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.012824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.013101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.013377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.024308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:52.029385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:52.030248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 63/112] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:52.031441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.060563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.114627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e39e-0024-4f9f-9aa2-edf1c84aafb2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.135069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13279f9-5bc6-4c67-9230-0c7080e84345 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.149628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dda47-8ca7-42d7-a1d6-de25cbb004db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.150276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dda47-8ca7-42d7-a1d6-de25cbb004db None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.150554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dda47-8ca7-42d7-a1d6-de25cbb004db None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.150860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dda47-8ca7-42d7-a1d6-de25cbb004db None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.151989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dda47-8ca7-42d7-a1d6-de25cbb004db None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.153436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dda47-8ca7-42d7-a1d6-de25cbb004db None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.155120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 50/113] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:51 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:52.159964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2313-641a-444f-959b-0d7ead60cb60 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.159964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2313-641a-444f-959b-0d7ead60cb60 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.159964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2313-641a-444f-959b-0d7ead60cb60 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.159964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 51/114] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:52.159964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2313-641a-444f-959b-0d7ead60cb60 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.176979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.177626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.177958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.178235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.188635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:52.193650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:52.194639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:52.195534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 64/115] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:52.199669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.229802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.272414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2313-641a-444f-959b-0d7ead60cb60 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.291180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.304360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49c034-2ef6-4696-859a-8ce286f34fc9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.305797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.306419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.306696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.306997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.307675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:52.307982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.309419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.318158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 52/116] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:52.318702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.340814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9abb79-40f7-4dd5-8456-9b19bd5f04e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.341455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abb79-40f7-4dd5-8456-9b19bd5f04e1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.341733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abb79-40f7-4dd5-8456-9b19bd5f04e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.342001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abb79-40f7-4dd5-8456-9b19bd5f04e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.343175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9abb79-40f7-4dd5-8456-9b19bd5f04e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.344629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9abb79-40f7-4dd5-8456-9b19bd5f04e1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.346202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 65/117] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:52.347340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d249-99ca-40dd-97a7-a05f0bb14c26 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.347622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d249-99ca-40dd-97a7-a05f0bb14c26 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.347895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d249-99ca-40dd-97a7-a05f0bb14c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.366365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-89f9d249-99ca-40dd-97a7-a05f0bb14c26 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:52.367599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-89f9d249-99ca-40dd-97a7-a05f0bb14c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:52.420419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ab36-3276-467d-b5d3-38e97b76235d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.432015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 66/118] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:52.432816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9d249-99ca-40dd-97a7-a05f0bb14c26 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.445481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.457043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.457660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.457948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.458282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.459082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] RBAC: Adding query filter params (role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=8e6ed3e95e9c4646b813f7eafae524b9) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:52.459356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.460818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.466703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 53/119] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/role_assignments?user.id=8e6ed3e95e9c4646b813f7eafae524b9&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:52.467331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.547600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.566202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9d249-99ca-40dd-97a7-a05f0bb14c26 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.596255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b020f-34ed-4bf4-afdc-2e96bdc491d1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.614064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.614904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.615445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.615773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.616613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:52.616910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.618407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.629532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 67/120] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:52.630407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.644392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.645161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.645752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.645898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.658319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:52.664771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:52.665635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:52.666405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 54/121] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:52.667078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.721927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.750710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188ba4b-e17f-4161-a960-8e9aa1a4546b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.776217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab00cf0-c3e8-4ff1-9134-31f15b692da1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.786865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.787512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.787788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.788056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] PATH_INFO: `/v3/users/d29816653d6248568ba7209d83b507fb` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.789264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] RBAC: Authorizing `identity:get_user(user_id=d29816653d6248568ba7209d83b507fb)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.790707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.792524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 68/122] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/users/d29816653d6248568ba7209d83b507fb => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:52.795725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.811432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.812058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.812447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.812723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.813509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.815015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.815647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.846750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 55/123] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:15:52 2022] POST /identity/v3/projects => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:52.847481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:52.936920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b432-ba93-457f-9b88-eec279dfe538 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.977618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:52.978452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:52.978793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:52.979106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:52.981000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:52.982511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:52.983194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea495c-68c0-4707-85b3-5d127a51021a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:52.984384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 69/124] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:52.987239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:52.990222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.023591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.024621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.025122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.025607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.026565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:53.027184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.028670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.042189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 56/125] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:53.043498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.096365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:53.120150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e8e8-f2ce-4f47-9a2b-63f7d1052d3c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.153947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244d9c2-cfe9-4ce9-a5ad-053d72138524 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.158191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.158859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.159142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.159412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.171278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:53.177885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:53.178763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:53.179576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 70/126] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:53.180219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.197781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.198775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.199386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.199945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.201438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.203171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.205551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 57/127] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:53 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:53.206544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.238001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:53.312469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143cb5-da8b-4b65-a62f-1f47f87df731 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.319985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b930d-2c94-48e4-b186-adeac5abce36 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.349072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.350533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.351042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.351512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.352955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.354657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.357326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 71/128] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:53 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:53.358346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.360111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.360751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.361029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.361301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.362685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.365137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.366767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 58/129] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:53 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:53.367518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.377062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:53.482216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd22a-c87b-4ae4-b7d8-23b071eb0add None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.493510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:53.501254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef2f0-07be-4fd1-93a1-04055e2ff1c3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.528213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.529156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.529676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.530144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.531034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:53.531526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.541917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.550741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.551456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.551740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.552068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70/users/d29816653d6248568ba7209d83b507fb/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.553200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 72/130] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:53.554235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.559568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] RBAC: Authorizing `identity:create_grant(project_id=58b627a5b2654721969213a82bb92f70, user_id=d29816653d6248568ba7209d83b507fb, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.561080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.586856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 59/131] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:15:53 2022] PUT /identity/v3/projects/58b627a5b2654721969213a82bb92f70/users/d29816653d6248568ba7209d83b507fb/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:15:53.586856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.672322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:53.702918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd455ed-9508-4f62-94e3-43b42b2a6cbd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.752891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30492-f17d-417d-927a-c10742dc8f72 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.790423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.791116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.791400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.791672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.792934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.794510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.795574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:53.796248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 60/132] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:53 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:53.796658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:53.796949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:53.797096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.797289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70/users/d0e577d4147e404ca97862a7fb601d97/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:53.802785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] RBAC: Authorizing `identity:create_grant(project_id=58b627a5b2654721969213a82bb92f70, user_id=d0e577d4147e404ca97862a7fb601d97, role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:53.804333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:53.830500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:53.837205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 73/133] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:15:53 2022] PUT /identity/v3/projects/58b627a5b2654721969213a82bb92f70/users/d0e577d4147e404ca97862a7fb601d97/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:15:53.838114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:53.953651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d4b4-736a-4126-957b-af715409bed5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:53.984126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224178-d5da-4432-ba4d-2b934662cf90 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:54.003539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:54.004603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:54.005116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:54.005577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:54.007998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:54.010553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:54.013447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 61/134] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:53 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:54.023815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:54.037830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:54.038530 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:54.038835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:54.039121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70/users/d0e577d4147e404ca97862a7fb601d97/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:54.041211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] RBAC: Authorizing `identity:create_grant(project_id=58b627a5b2654721969213a82bb92f70, user_id=d0e577d4147e404ca97862a7fb601d97, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:54.042731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:54.045458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:54.073223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 74/135] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:15:53 2022] PUT /identity/v3/projects/58b627a5b2654721969213a82bb92f70/users/d0e577d4147e404ca97862a7fb601d97/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:15:54.176538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:54.188041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdd088-7ed2-4db1-9d03-954c905aafcc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:54.250286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505b2ed-8bac-4e43-9912-b8588c9d7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:54.250879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505b2ed-8bac-4e43-9912-b8588c9d7d91 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:54.251167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505b2ed-8bac-4e43-9912-b8588c9d7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:54.251441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505b2ed-8bac-4e43-9912-b8588c9d7d91 None admin] PATH_INFO: `/v3/projects/bb05c9170fdc45f2b79d39e0783fc009` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:54.255676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505b2ed-8bac-4e43-9912-b8588c9d7d91 None admin] RBAC: Authorizing `identity:get_project(project_id=bb05c9170fdc45f2b79d39e0783fc009)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:54.257186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505b2ed-8bac-4e43-9912-b8588c9d7d91 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:54.258924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 62/136] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:54 2022] GET /identity/v3/projects/bb05c9170fdc45f2b79d39e0783fc009 => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:54.264970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:54.399540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa136e2a-f910-431a-afd2-269041942fba None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:54.435407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f5772-e6b0-4bda-ae50-7df97a1ac9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:54.436088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5772-e6b0-4bda-ae50-7df97a1ac9b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:54.436373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5772-e6b0-4bda-ae50-7df97a1ac9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:54.436646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5772-e6b0-4bda-ae50-7df97a1ac9b7 None admin] PATH_INFO: `/v3/projects/bb05c9170fdc45f2b79d39e0783fc009/users/d0e577d4147e404ca97862a7fb601d97/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:54.438594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f5772-e6b0-4bda-ae50-7df97a1ac9b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb05c9170fdc45f2b79d39e0783fc009, user_id=d0e577d4147e404ca97862a7fb601d97, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:54.440125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f5772-e6b0-4bda-ae50-7df97a1ac9b7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:54.457799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 75/137] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:15:54 2022] PUT /identity/v3/projects/bb05c9170fdc45f2b79d39e0783fc009/users/d0e577d4147e404ca97862a7fb601d97/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:15:54.879346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42de348-af94-4b77-953d-cbebdef74a30 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:54.879825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42de348-af94-4b77-953d-cbebdef74a30 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:54.879825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42de348-af94-4b77-953d-cbebdef74a30 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:54.881366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 63/138] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:54.887362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3fcd-2c48-4071-8b1c-c8363470095f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:54.887658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3fcd-2c48-4071-8b1c-c8363470095f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:54.887942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3fcd-2c48-4071-8b1c-c8363470095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:54.910808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-569c3fcd-2c48-4071-8b1c-c8363470095f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:54.912083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-569c3fcd-2c48-4071-8b1c-c8363470095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:54.964503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:54.983991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 76/139] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:55.512313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42de348-af94-4b77-953d-cbebdef74a30 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:55.555711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a03151-dbf2-4932-8227-b94a81d02aa0 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:55.556217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a03151-dbf2-4932-8227-b94a81d02aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:55.556217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a03151-dbf2-4932-8227-b94a81d02aa0 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:55.557822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 77/140] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:55.562556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47105632-222a-4dfe-bc0e-4b6bed9ef755 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:55.562853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47105632-222a-4dfe-bc0e-4b6bed9ef755 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:55.563116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47105632-222a-4dfe-bc0e-4b6bed9ef755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:55.606564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-47105632-222a-4dfe-bc0e-4b6bed9ef755 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:55.607835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-47105632-222a-4dfe-bc0e-4b6bed9ef755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:55.745526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42de348-af94-4b77-953d-cbebdef74a30 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:55.758370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 78/141] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:15:55.797391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:55.797951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:55.798229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:55.798499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:55.812128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:55.816854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:55.817762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:55.818519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 64/142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:55.825207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47105632-222a-4dfe-bc0e-4b6bed9ef755 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:55.928247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47105632-222a-4dfe-bc0e-4b6bed9ef755 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:55.947765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:55.984429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:55.985067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:55.985336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:55.985603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:55.986292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:55.986587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:55.988002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:55.997317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 79/143] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:56.002775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:56.032785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:56.129917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8134-6ec8-41eb-8c44-3a64c73befd1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:56.177843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:56.178496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:56.178758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:56.179075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] PATH_INFO: `/v3/users/8e6ed3e95e9c4646b813f7eafae524b9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:56.183514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] RBAC: Authorizing `identity:get_user(user_id=8e6ed3e95e9c4646b813f7eafae524b9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:56.185014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:56.186798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 65/144] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:56 2022] GET /identity/v3/users/8e6ed3e95e9c4646b813f7eafae524b9 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:56.192346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:56.241335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:56.313671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488799f-d0a2-4252-9377-e153b03a5931 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:56.360051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:56.360716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:56.360986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:56.361252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:56.365460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:56.366925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:56.370063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 80/145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:56 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:56.374399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:56.453986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:56.479005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98fb12-54cb-4a63-8b0c-a5a15fb668a8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:56.483255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:56.549365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:56.550010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:56.550285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:56.550551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:56.554287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:56.555794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:56.557550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 66/146] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:15:56.565419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:56.590291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef829797-2bc1-4522-ab49-b70981be6ed6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:56.662624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b4463-68ef-4030-8419-7f147ee6fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:56.663325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b4463-68ef-4030-8419-7f147ee6fc4d None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:56.663598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b4463-68ef-4030-8419-7f147ee6fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:56.663869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b4463-68ef-4030-8419-7f147ee6fc4d None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70/users/8e6ed3e95e9c4646b813f7eafae524b9/roles/c6074ceff02c4ce8b1e81d0ccdc65dd9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:56.665899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b4463-68ef-4030-8419-7f147ee6fc4d None admin] RBAC: Authorizing `identity:create_grant(project_id=58b627a5b2654721969213a82bb92f70, user_id=8e6ed3e95e9c4646b813f7eafae524b9, role_id=c6074ceff02c4ce8b1e81d0ccdc65dd9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:56.667379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b4463-68ef-4030-8419-7f147ee6fc4d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:56.700374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 81/147] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:15:56 2022] PUT /identity/v3/projects/58b627a5b2654721969213a82bb92f70/users/8e6ed3e95e9c4646b813f7eafae524b9/roles/c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:15:56.745499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df814ad6-b40e-4938-bd76-da2b1a9aa047 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:56.787277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2d275-28bb-4fb4-b11f-99341a9fd9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:56.787933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2d275-28bb-4fb4-b11f-99341a9fd9a8 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:56.788250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2d275-28bb-4fb4-b11f-99341a9fd9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:56.788525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2d275-28bb-4fb4-b11f-99341a9fd9a8 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:56.789213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2d275-28bb-4fb4-b11f-99341a9fd9a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:56.790740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2d275-28bb-4fb4-b11f-99341a9fd9a8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:56.820052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 67/148] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:15:56 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:15:56.876251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4821-413c-402d-9b20-a9cdef8fc311 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:56.876604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4821-413c-402d-9b20-a9cdef8fc311 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:56.876795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4821-413c-402d-9b20-a9cdef8fc311 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:56.878551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 82/149] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:56.884946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb49b-4e49-4ed5-a14c-b1fe5e9ca632 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:56.885276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb49b-4e49-4ed5-a14c-b1fe5e9ca632 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:56.885510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb49b-4e49-4ed5-a14c-b1fe5e9ca632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:56.906293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-210eb49b-4e49-4ed5-a14c-b1fe5e9ca632 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:56.907668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-210eb49b-4e49-4ed5-a14c-b1fe5e9ca632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:56.916921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:56.987750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 68/150] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:57.293505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4821-413c-402d-9b20-a9cdef8fc311 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:57.424633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b147349-2679-41e2-9f84-ab3d6ca00eb2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.424633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b147349-2679-41e2-9f84-ab3d6ca00eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.425519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b147349-2679-41e2-9f84-ab3d6ca00eb2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.426276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 69/151] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:15:57.432419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea0a66-1e48-4a6a-a378-2e5728d49501 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.432735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea0a66-1e48-4a6a-a378-2e5728d49501 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.432964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea0a66-1e48-4a6a-a378-2e5728d49501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.442855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4821-413c-402d-9b20-a9cdef8fc311 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:57.447455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:57.480044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-43ea0a66-1e48-4a6a-a378-2e5728d49501 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:57.481290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-43ea0a66-1e48-4a6a-a378-2e5728d49501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:57.525227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23379267-9c23-466b-a7c7-fc6c9439db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:57.525882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23379267-9c23-466b-a7c7-fc6c9439db5c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.526149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23379267-9c23-466b-a7c7-fc6c9439db5c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.526420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23379267-9c23-466b-a7c7-fc6c9439db5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.547274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23379267-9c23-466b-a7c7-fc6c9439db5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-23379267-9c23-466b-a7c7-fc6c9439db5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:57.552127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:57.553022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 83/152] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:57.562368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1329e-854f-4a63-8136-1d53a8df75a3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.563240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1329e-854f-4a63-8136-1d53a8df75a3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.563240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1329e-854f-4a63-8136-1d53a8df75a3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.563240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 84/153] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:57.564671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced67e4-7d07-42c1-87d7-05d6e1d674fe None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.565091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced67e4-7d07-42c1-87d7-05d6e1d674fe None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.565497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced67e4-7d07-42c1-87d7-05d6e1d674fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.589044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fced67e4-7d07-42c1-87d7-05d6e1d674fe None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:57.590482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fced67e4-7d07-42c1-87d7-05d6e1d674fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:57.593940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 70/154] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:57.595050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea0a66-1e48-4a6a-a378-2e5728d49501 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:57.664598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 85/155] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:57.685820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:57.727347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea0a66-1e48-4a6a-a378-2e5728d49501 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:57.770146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a721a53-a7e0-464a-9ce2-a6942ba12542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:57.771024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721a53-a7e0-464a-9ce2-a6942ba12542 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.771312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721a53-a7e0-464a-9ce2-a6942ba12542 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.771582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721a53-a7e0-464a-9ce2-a6942ba12542 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.772329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a721a53-a7e0-464a-9ce2-a6942ba12542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:57.772633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a721a53-a7e0-464a-9ce2-a6942ba12542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:57.774037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a721a53-a7e0-464a-9ce2-a6942ba12542 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:57.784682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 71/156] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:57.791981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced67e4-7d07-42c1-87d7-05d6e1d674fe None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:57.922239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:57.929052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced67e4-7d07-42c1-87d7-05d6e1d674fe None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:57.971586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:57.972269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.972534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.972802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] PATH_INFO: `/v3/users/d29816653d6248568ba7209d83b507fb` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.974074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] RBAC: Authorizing `identity:get_user(user_id=d29816653d6248568ba7209d83b507fb)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:57.975946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:57.977546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 86/157] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:57 2022] GET /identity/v3/users/d29816653d6248568ba7209d83b507fb => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:57.981251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13ace7-e9b3-4758-9ca4-2c80899062c6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.981539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13ace7-e9b3-4758-9ca4-2c80899062c6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.981819 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13ace7-e9b3-4758-9ca4-2c80899062c6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:57.983293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 72/158] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:15:57.987475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:57.989065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e0dc-470a-48fe-9e95-30109d30ff18 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:57.989424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e0dc-470a-48fe-9e95-30109d30ff18 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:57.989696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e0dc-470a-48fe-9e95-30109d30ff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:58.017981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-67f6e0dc-470a-48fe-9e95-30109d30ff18 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:15:58.019261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-67f6e0dc-470a-48fe-9e95-30109d30ff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:15:58.101188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 73/159] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:15:58.103867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6e0dc-470a-48fe-9e95-30109d30ff18 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:58.169180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:58.170541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79167888-2f58-44fa-b01a-abbfee1f2e2f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:58.216747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6e0dc-470a-48fe-9e95-30109d30ff18 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:58.235768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:58.236396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:58.236667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:58.236933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:58.255705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:58.256366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:58.256633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:58.256900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:58.281097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:58.287400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:58.288266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:15:58.289128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:58.290217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 74/160] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:58.292464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:58.302304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:58.364077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:58.365602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:58.441536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b31e4f-2f54-487b-8406-eb5375f0ec26 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:58.469221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:58.487108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:58.488899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:58.492067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:58.492644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:58.511071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:58.517565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:58.518504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:58.519326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:15:58.523334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 87/161] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:15:58.524411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:58.526199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 75/162] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:58.534297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:58.647183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:58.707645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd55575-ffa9-4605-9f60-24d63e06a8e8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:58.722255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03685d6b-81e7-45e7-ba4e-5ce74fc07971 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:58.762208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:58.762886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:58.763167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:58.763435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:58.764708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:58.766188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:58.767860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 76/163] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:15:58 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:58.776496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:58.782324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:58.782973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:58.783265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:58.783524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:58.784200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:58.784504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:58.785896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:58.805106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 88/164] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:58.808637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:58.858760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:58.919409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540dc4-38a1-4fc0-8321-3a8cd9acbafd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:58.963654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:58.964742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:58.965232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:58.965686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:58.966559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:58.967020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:58.968583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:58.986110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 77/165] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:58.987872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:58.990474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7426ee-743c-463c-bd20-9b970ceafec2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:59.042608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:59.062206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:59.062870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:59.063150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:59.063424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:59.087724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:15:59.100348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:15:59.101252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:15:59.102039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 89/166] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:15:59.102687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:59.164722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeefcf-e962-4d52-99e2-dd94382e90e2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:59.179215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:59.200702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:59.202075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:59.202353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:59.202627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:59.203428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=d29816653d6248568ba7209d83b507fb) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:59.203736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:59.205209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:59.211888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 78/167] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:15:58 2022] GET /identity/v3/role_assignments?user.id=d29816653d6248568ba7209d83b507fb&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:59.221178 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:59.324225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01978ad-336c-4ed6-ac9e-b57d9d653a35 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:59.385899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:59.386576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:59.386885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:59.387161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:59.389159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:59.390811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:59.392653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 90/168] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:59 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:59.393700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:59.461211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60941-092b-4916-beea-a92607fc37c0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:59.499675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:59.532966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:59.533644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:59.533913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:59.534184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:59.539616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:59.541139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:59.542858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 79/169] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:15:59 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:59.543714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:59.605164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c60887-2e69-4467-a930-2b43407a6f17 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:59.611171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:59.706853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:59.711600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:59.711881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:59.712154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:59.712853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:15:59.713157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:59.714554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:59.731421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 91/170] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:15:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:15:59.736226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:15:59.758557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a05f0-de50-4154-8bd0-803e96b5ac50 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:59.832380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:59.833054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:59.833331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:59.833603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:15:59.909724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a13b37-76e1-4a8d-94ed-cf5d33946c4e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:15:59.925034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:15:59.955280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:15:59.956785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:15:59.967998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:15:59.968629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:15:59.968904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:15:59.969171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.031496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:00.063819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:00.065326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:00.120688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 80/171] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:00.121890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:00.220627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80fefb-59de-46c3-87e4-de0422319620 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:00.256596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ce6df-85c4-4c9d-8c20-377d8b290059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:00.257611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce6df-85c4-4c9d-8c20-377d8b290059 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:00.258099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce6df-85c4-4c9d-8c20-377d8b290059 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:00.258569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce6df-85c4-4c9d-8c20-377d8b290059 None admin] PATH_INFO: `/v3/users/d0e577d4147e404ca97862a7fb601d97` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.259981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ce6df-85c4-4c9d-8c20-377d8b290059 None admin] RBAC: Authorizing `identity:get_user(user_id=d0e577d4147e404ca97862a7fb601d97)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:00.261750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ce6df-85c4-4c9d-8c20-377d8b290059 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:00.263957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 81/172] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:00 2022] GET /identity/v3/users/d0e577d4147e404ca97862a7fb601d97 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:00.265272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64a6a-a2d2-43df-94ce-ccd5a31f7ae7 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:00.270163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64a6a-a2d2-43df-94ce-ccd5a31f7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:00.270802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64a6a-a2d2-43df-94ce-ccd5a31f7ae7 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.272297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 82/173] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:00.273177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64a6a-a2d2-43df-94ce-ccd5a31f7ae7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:00.293695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:00.301109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 92/174] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:00.304202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:00.341521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:00.388203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64a6a-a2d2-43df-94ce-ccd5a31f7ae7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:00.423317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997967cd-fa63-4096-885c-27b6cee4417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:00.424232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997967cd-fa63-4096-885c-27b6cee4417f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:00.424646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997967cd-fa63-4096-885c-27b6cee4417f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:00.425075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997967cd-fa63-4096-885c-27b6cee4417f None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.426393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997967cd-fa63-4096-885c-27b6cee4417f None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:00.428144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997967cd-fa63-4096-885c-27b6cee4417f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:00.429933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 83/175] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:00 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:00.431315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619374a-34be-4d3a-89db-905798043b6e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:00.431737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619374a-34be-4d3a-89db-905798043b6e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:00.432165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619374a-34be-4d3a-89db-905798043b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.451194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b619374a-34be-4d3a-89db-905798043b6e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:00.452643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b619374a-34be-4d3a-89db-905798043b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:00.525754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 84/176] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:00.531612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619374a-34be-4d3a-89db-905798043b6e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:00.557984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:00.566967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41f584-cad6-406b-a201-3bec20938f35 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:00.664852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374f3ab-de21-48e8-affc-a4db7eed72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:00.665472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374f3ab-de21-48e8-affc-a4db7eed72e3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:00.665746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374f3ab-de21-48e8-affc-a4db7eed72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:00.666014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374f3ab-de21-48e8-affc-a4db7eed72e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.729191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619374a-34be-4d3a-89db-905798043b6e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:00.757012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374f3ab-de21-48e8-affc-a4db7eed72e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:00.758500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374f3ab-de21-48e8-affc-a4db7eed72e3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:00.781043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:00.819268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:00.820167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:00.820592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:00.820999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.829611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:00.831378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:00.833304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 85/177] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:00 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:00.834194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:00.904784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 93/178] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:00.904784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051efd1-1274-4ece-bf3b-9c551d244bb4 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:00.904784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051efd1-1274-4ece-bf3b-9c551d244bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:00.904784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051efd1-1274-4ece-bf3b-9c551d244bb4 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:00.905167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 94/179] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:00.912984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051efd1-1274-4ece-bf3b-9c551d244bb4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:01.056242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051efd1-1274-4ece-bf3b-9c551d244bb4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:01.074768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:01.101201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:01.107985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:01.108858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.108962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.109239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.109926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=d0e577d4147e404ca97862a7fb601d97) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:01.110226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:01.111918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:01.124272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 95/180] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:00 2022] GET /identity/v3/role_assignments?user.id=d0e577d4147e404ca97862a7fb601d97&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:01.124272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:01.156609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ccf6-84d8-4364-a7bb-048ebb12206a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:01.289823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:01.290927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.291409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.291886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.293173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] RBAC: Adding query filter params (role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=d0e577d4147e404ca97862a7fb601d97) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:01.297144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:01.299216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:01.320023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 86/181] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:00 2022] GET /identity/v3/role_assignments?user.id=d0e577d4147e404ca97862a7fb601d97&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 608 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:01.321759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:01.454502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c124f4c-fc90-45cc-96a1-30bfcbf96e32 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:01.498532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5d9dc-34b9-4e7d-a807-af49c93741bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:01.499597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5d9dc-34b9-4e7d-a807-af49c93741bc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.500096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5d9dc-34b9-4e7d-a807-af49c93741bc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.500774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5d9dc-34b9-4e7d-a807-af49c93741bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.513667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5d9dc-34b9-4e7d-a807-af49c93741bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7dc5d9dc-34b9-4e7d-a807-af49c93741bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:01.519248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:01.520243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:01.521188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 96/182] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:01.522064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e458dc-b5fc-4a81-bbb9-90048eaf151e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.522344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e458dc-b5fc-4a81-bbb9-90048eaf151e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.522602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e458dc-b5fc-4a81-bbb9-90048eaf151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.533085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f5778-dc60-42d3-b236-6b9141529231 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:01.542651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-27e458dc-b5fc-4a81-bbb9-90048eaf151e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:01.543918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-27e458dc-b5fc-4a81-bbb9-90048eaf151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:01.572933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a02b4a-028d-448a-8435-a4f9085190d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:01.573609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a02b4a-028d-448a-8435-a4f9085190d2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.573956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a02b4a-028d-448a-8435-a4f9085190d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.574294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a02b4a-028d-448a-8435-a4f9085190d2 None admin] PATH_INFO: `/v3/projects/bb05c9170fdc45f2b79d39e0783fc009` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.575893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a02b4a-028d-448a-8435-a4f9085190d2 None admin] RBAC: Authorizing `identity:get_project(project_id=bb05c9170fdc45f2b79d39e0783fc009)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:01.578344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:01.578596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a02b4a-028d-448a-8435-a4f9085190d2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:01.580302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 87/183] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:01 2022] GET /identity/v3/projects/bb05c9170fdc45f2b79d39e0783fc009 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:01.584124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c451f-b406-4ae0-a649-95c7757d25dc None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.584592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c451f-b406-4ae0-a649-95c7757d25dc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.584981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c451f-b406-4ae0-a649-95c7757d25dc None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.586535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 88/184] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:01.587473 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b386-6156-4252-bf44-e067933dd8b5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.587743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b386-6156-4252-bf44-e067933dd8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.588125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b386-6156-4252-bf44-e067933dd8b5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.589444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 89/185] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:01.589972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33b386-6156-4252-bf44-e067933dd8b5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:01.608680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:01.627737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 97/186] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:01.628594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e458dc-b5fc-4a81-bbb9-90048eaf151e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:01.716442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33b386-6156-4252-bf44-e067933dd8b5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:01.761734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16890904-2d54-4621-9bdd-4d2eec2a6f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:01.762655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890904-2d54-4621-9bdd-4d2eec2a6f4b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.763098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890904-2d54-4621-9bdd-4d2eec2a6f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.763724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890904-2d54-4621-9bdd-4d2eec2a6f4b None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.765144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890904-2d54-4621-9bdd-4d2eec2a6f4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:01.765597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890904-2d54-4621-9bdd-4d2eec2a6f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:01.767348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e458dc-b5fc-4a81-bbb9-90048eaf151e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:01.767808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890904-2d54-4621-9bdd-4d2eec2a6f4b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:01.777704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 90/187] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:01.782741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28326b95-e2e1-4d74-a173-1d70312e4987 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.782741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28326b95-e2e1-4d74-a173-1d70312e4987 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.782741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28326b95-e2e1-4d74-a173-1d70312e4987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.798460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-28326b95-e2e1-4d74-a173-1d70312e4987 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:01.799674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-28326b95-e2e1-4d74-a173-1d70312e4987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:01.806215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5be217-ddf0-41be-b214-7eceb74974cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:01.807333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be217-ddf0-41be-b214-7eceb74974cf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.807620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be217-ddf0-41be-b214-7eceb74974cf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.807893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be217-ddf0-41be-b214-7eceb74974cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.808627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be217-ddf0-41be-b214-7eceb74974cf None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=bb05c9170fdc45f2b79d39e0783fc009, user.id=d0e577d4147e404ca97862a7fb601d97) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:01.809293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be217-ddf0-41be-b214-7eceb74974cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:01.811103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be217-ddf0-41be-b214-7eceb74974cf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:01.818002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 98/188] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:01 2022] GET /identity/v3/role_assignments?user.id=d0e577d4147e404ca97862a7fb601d97&scope.project.id=bb05c9170fdc45f2b79d39e0783fc009&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:01.823176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7e51-0a1b-4ff6-be4e-e8d6b5ae1494 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:01.823176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7e51-0a1b-4ff6-be4e-e8d6b5ae1494 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:01.823176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7e51-0a1b-4ff6-be4e-e8d6b5ae1494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:01.847733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3ddd7e51-0a1b-4ff6-be4e-e8d6b5ae1494 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:01.850027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3ddd7e51-0a1b-4ff6-be4e-e8d6b5ae1494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:01.871058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 91/189] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:01.871897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28326b95-e2e1-4d74-a173-1d70312e4987 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:01.887005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:01.899239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:01.943860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 99/190] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:01.944728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7e51-0a1b-4ff6-be4e-e8d6b5ae1494 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.016306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28326b95-e2e1-4d74-a173-1d70312e4987 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.079819 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.081145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.081619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.082337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] PATH_INFO: `/v3/users/8e6ed3e95e9c4646b813f7eafae524b9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.085408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] RBAC: Authorizing `identity:get_user(user_id=8e6ed3e95e9c4646b813f7eafae524b9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.087991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.091716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 92/191] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:01 2022] GET /identity/v3/users/8e6ed3e95e9c4646b813f7eafae524b9 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:02.091852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7e51-0a1b-4ff6-be4e-e8d6b5ae1494 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.103901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.151578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.152281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.152663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.152932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.169816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:02.177283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:02.178148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:02.179167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 100/192] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:02.184109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.213077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.219908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.260550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f613b14-6bf7-4015-8891-10449886a110 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.293150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.293754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.294026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.294284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.297274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311784-3b49-44ac-a781-d0004651a70d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.333225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.333766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.334045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.334313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.335028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:02.335332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.336745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.350043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 101/193] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:02.350043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.360691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.362179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.428465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.430908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.447049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b06bd4-4bdc-4ff6-9620-2a69efbea3d6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.461526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 93/194] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:02.462878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.485677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.486328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.486604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.486889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.497133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:02.502439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:02.503376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:02.504183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 102/195] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:02.504911 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.559998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099da33a-9af0-4ca3-99a8-d6c42f444b3c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.593231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.593798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.594076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.594401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.595490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.596976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.598617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 94/196] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:02.599400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.601331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7187c9-b55b-4015-9ef5-a7c86c0c1507 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.635103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.635738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.636007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.636272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] PATH_INFO: `/v3/users/21cc952fedba4dd197d34f102a343623` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.642765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.649825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] RBAC: Authorizing `identity:get_user(user_id=21cc952fedba4dd197d34f102a343623)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.651346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.652998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 103/197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/users/21cc952fedba4dd197d34f102a343623 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:02.653886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.656571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.702940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c7959-9dc6-4f6c-942e-89f455fc636a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.736317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.736956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.737232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.737503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.738621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.740149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.741801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 95/198] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:02.742534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.752546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6d5b4-caa7-4116-833d-63481282258b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.786616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.787251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.787520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.787788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.788455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:02.788754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.790131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.802591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 104/199] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:02.802591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.840695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3cd6-d26c-43ae-960d-6011ece929bf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.850225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.860216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:02.877543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.878148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.878415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.878681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:02.879375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:02.880870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:02.900316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3aa68-e2fb-4990-904f-2247585072f3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:02.901368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 96/200] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:02 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:02.902172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:02.943316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:02.943953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:02.944227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:02.944496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.016452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec8cb-4411-47b9-a2c8-bee1ea02127c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:03.020636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.022142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.052202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:03.052875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:03.053146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:03.053411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.054151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] RBAC: Adding query filter params (role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9, scope.project.id=58b627a5b2654721969213a82bb92f70, user.id=8e6ed3e95e9c4646b813f7eafae524b9) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:03.054452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.055963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.062430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 97/201] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/role_assignments?user.id=8e6ed3e95e9c4646b813f7eafae524b9&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:03.063782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:03.095934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:03.099201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:03.148652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 105/202] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:03.155542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:03.197545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c3b6-9f31-4fb6-860b-11913fa7a2f0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:03.248050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:03.248797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:03.249143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:03.249485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] PATH_INFO: `/v3/users/21cc952fedba4dd197d34f102a343623` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.251725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] RBAC: Authorizing `identity:get_user(user_id=21cc952fedba4dd197d34f102a343623)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.253305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.255102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 98/203] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:03 2022] GET /identity/v3/users/21cc952fedba4dd197d34f102a343623 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:03.262259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:03.290988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79b91-8f4e-4bef-9bd6-1879350be80f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:03.343123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:03.343846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:03.344157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:03.344427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.345723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.347457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.350383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 106/204] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:03 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:03.356316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:03.380277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:03.385466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925cad8-91f4-4fd2-b4fb-8476e14c20f3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:03.394406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:03.430196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:03.431016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:03.431570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:03.431864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.479953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3b5b7-964a-4b88-9da3-e7f465543312 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:03.515714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.517970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.522670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:03.523401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:03.523680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:03.523944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.524739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=21cc952fedba4dd197d34f102a343623) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:03.525042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.527009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.534154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 107/205] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:03 2022] GET /identity/v3/role_assignments?user.id=21cc952fedba4dd197d34f102a343623&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:03.628516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:03.636561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 99/206] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 07:16:03.642266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:03.749332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e19f-70dc-4793-823f-0b26926f50d8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:03.756931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:03.783376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9b3d-18a3-4e9a-ac1d-b661929bfdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:03.784016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9b3d-18a3-4e9a-ac1d-b661929bfdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:03.784287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9b3d-18a3-4e9a-ac1d-b661929bfdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:03.784556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9b3d-18a3-4e9a-ac1d-b661929bfdc6 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.785671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9b3d-18a3-4e9a-ac1d-b661929bfdc6 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.787282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9b3d-18a3-4e9a-ac1d-b661929bfdc6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.789147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 108/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:03 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:03.794970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:03.900729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d440a7-3d38-4fde-9d35-07d2ff4cce0d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:03.937747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9d77b-4a68-42b7-8701-6d4bb1019806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:03.938372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d77b-4a68-42b7-8701-6d4bb1019806 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:03.938649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d77b-4a68-42b7-8701-6d4bb1019806 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:03.938956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d77b-4a68-42b7-8701-6d4bb1019806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:03.939687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9d77b-4a68-42b7-8701-6d4bb1019806 None admin] RBAC: Adding query filter params (role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=21cc952fedba4dd197d34f102a343623) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:03.939991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9d77b-4a68-42b7-8701-6d4bb1019806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:03.941447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9d77b-4a68-42b7-8701-6d4bb1019806 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:03.947583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 100/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:03 2022] GET /identity/v3/role_assignments?user.id=21cc952fedba4dd197d34f102a343623&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:05.367968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a149-3376-4514-b27c-85df0784d95a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:05.368527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a149-3376-4514-b27c-85df0784d95a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:05.368527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a149-3376-4514-b27c-85df0784d95a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:05.369425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820c4f-3fe2-43ea-bb89-0eb498aae589 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:05.370090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 109/209] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:05.370561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820c4f-3fe2-43ea-bb89-0eb498aae589 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:05.371061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820c4f-3fe2-43ea-bb89-0eb498aae589 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:05.372811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 101/210] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:05.375253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aafc5-6365-433b-a7f0-70074f4e28bf None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:05.375536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aafc5-6365-433b-a7f0-70074f4e28bf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:05.375813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651aafc5-6365-433b-a7f0-70074f4e28bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:05.380139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d5dfb-2f06-461f-b6dc-411bf09ad731 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:05.380663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d5dfb-2f06-461f-b6dc-411bf09ad731 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:05.381119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d5dfb-2f06-461f-b6dc-411bf09ad731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:05.394984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-651aafc5-6365-433b-a7f0-70074f4e28bf None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:05.396249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-651aafc5-6365-433b-a7f0-70074f4e28bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:05.404626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-201d5dfb-2f06-461f-b6dc-411bf09ad731 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:05.406132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-201d5dfb-2f06-461f-b6dc-411bf09ad731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:05.474924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 110/211] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:05.491398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 102/212] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:05.491867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:05.714997 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29d32-1483-494f-ad34-8a15858c657b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:05.715274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29d32-1483-494f-ad34-8a15858c657b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:05.715785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29d32-1483-494f-ad34-8a15858c657b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:05.717613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 111/213] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:05.723009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f238979-5182-48ba-a0c1-838c7de0b6d5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:05.723573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f238979-5182-48ba-a0c1-838c7de0b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:05.724059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f238979-5182-48ba-a0c1-838c7de0b6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:05.743720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8f238979-5182-48ba-a0c1-838c7de0b6d5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:05.745360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8f238979-5182-48ba-a0c1-838c7de0b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:05.746439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29d32-1483-494f-ad34-8a15858c657b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:05.826316 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 103/214] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:05.834071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f238979-5182-48ba-a0c1-838c7de0b6d5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:05.866143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:05.877099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29d32-1483-494f-ad34-8a15858c657b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:05.924747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:05.925633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:05.926078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:05.926517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:05.928200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:05.929820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:05.932270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 112/215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:05.937815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:05.966293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f238979-5182-48ba-a0c1-838c7de0b6d5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:05.992229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:06.008623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.009567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.010059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.010550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.021647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:06.027167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:06.028044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:06.028820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:06.031139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 104/216] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:06.037594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.077495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657861f-3e1f-48a0-8f1f-4ee89a666bbd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.116328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f9f18-71f8-4c86-9a9b-361d9251cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.116946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9f18-71f8-4c86-9a9b-361d9251cd20 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.117224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9f18-71f8-4c86-9a9b-361d9251cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.117493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9f18-71f8-4c86-9a9b-361d9251cd20 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.118149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f9f18-71f8-4c86-9a9b-361d9251cd20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:06.126369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f9f18-71f8-4c86-9a9b-361d9251cd20 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:06.160651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 113/217] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:05 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:16:06.160883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c334ea-ac4d-470c-99c8-b39615e82ca9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.161002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22225-68c8-4144-8dd6-47dbae13598e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.161002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22225-68c8-4144-8dd6-47dbae13598e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.161002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22225-68c8-4144-8dd6-47dbae13598e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.161002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 114/218] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:06.161002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca22225-68c8-4144-8dd6-47dbae13598e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.181461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:06.203437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50412-ada2-4d19-9d59-478287fc7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.204332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50412-ada2-4d19-9d59-478287fc7915 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.204743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50412-ada2-4d19-9d59-478287fc7915 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.205176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50412-ada2-4d19-9d59-478287fc7915 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.206019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50412-ada2-4d19-9d59-478287fc7915 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:06.206583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50412-ada2-4d19-9d59-478287fc7915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:06.208281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50412-ada2-4d19-9d59-478287fc7915 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:06.222959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 105/219] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:06.225172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d140e28-0bc6-4816-9247-730635e82106 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.225606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d140e28-0bc6-4816-9247-730635e82106 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.226041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d140e28-0bc6-4816-9247-730635e82106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.245520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9d140e28-0bc6-4816-9247-730635e82106 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:06.247045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9d140e28-0bc6-4816-9247-730635e82106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:06.276865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca22225-68c8-4144-8dd6-47dbae13598e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.285204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:06.321298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.321975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.322469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.322744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.328771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 106/220] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:06.329711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d140e28-0bc6-4816-9247-730635e82106 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.342551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:06.348725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:06.350059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:06.350856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:06.352943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 115/221] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:06.359453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.451434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d140e28-0bc6-4816-9247-730635e82106 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.456110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:06.482902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f0d5-b3e9-42cf-8346-d196388a2f4c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.494398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.495084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.495484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.495774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] PATH_INFO: `/v3/users/d41803c350234fee88082cf65eb46dd4` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.513496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] RBAC: Authorizing `identity:get_user(user_id=d41803c350234fee88082cf65eb46dd4)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:06.515038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:06.516932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 107/222] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/users/d41803c350234fee88082cf65eb46dd4 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:06.525403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.526108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.526383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.526679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.527456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:06.527712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:06.527886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.529297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:06.539555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 116/223] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:06.547439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.563030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:06.656600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36e160-16be-4fdc-96a5-cb94f2dff71d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.670308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390ae9-1e25-4aa4-a465-5dd4216c9958 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.696152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.696777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.697119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.697394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.717712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.718720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.719210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.719673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] PATH_INFO: `/v3/users/21cc952fedba4dd197d34f102a343623` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.721825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] RBAC: Authorizing `identity:get_user(user_id=21cc952fedba4dd197d34f102a343623)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:06.724210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:06.726971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 117/224] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/users/21cc952fedba4dd197d34f102a343623 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:06.727949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.745279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:06.776500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:06.778387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:06.810438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:06.863824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e61b-34a2-4be3-b7cd-1bf2e6b331c4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:06.890373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 108/225] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:06.891592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:06.899963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:06.900814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:06.901348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:06.901836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:06.915072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:06.921260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:06.922154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:06.923021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:06.926164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 118/226] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:06.927332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:07.000765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f195-5baa-44af-b4b6-054808a612c1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.001443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:07.032144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:07.038573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd369da-d894-40dc-bde9-108e1939e51f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.039018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.039664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.039944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.040215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.041400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.042911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.044568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 109/227] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:07.045331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:07.084398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.085408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.085925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.086390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.087767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.089509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.091430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 119/228] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:06 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:07.092440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:07.152824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf546-00db-4b12-b026-34ce6233a8a1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.190939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.191220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.191510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.192513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:07.193255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.194998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.196296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae886f0-2a55-45b4-83a1-9e405e19c92b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.205340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 110/229] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:07.207503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:07.245754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.246606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.247264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.247650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2/users/21cc952fedba4dd197d34f102a343623/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.250869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] RBAC: Authorizing `identity:create_grant(project_id=1b001a834b944749a246332386bc50a2, user_id=21cc952fedba4dd197d34f102a343623, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.252397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.256923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:07.280623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 120/230] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:07 2022] PUT /identity/v3/projects/1b001a834b944749a246332386bc50a2/users/21cc952fedba4dd197d34f102a343623/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:07.280623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:07.286312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:07.365846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2986-0475-494d-936d-34af267f0053 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.423843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6f1eb-c11c-4c77-a802-a7e82aa0a57d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.445087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.445984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.446492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.446933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.447838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=d41803c350234fee88082cf65eb46dd4) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:07.448286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.452079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.465488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 111/231] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:07 2022] GET /identity/v3/role_assignments?user.id=d41803c350234fee88082cf65eb46dd4&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:07.481411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.482653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.483146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.483593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] PATH_INFO: `/v3/users/21cc952fedba4dd197d34f102a343623` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.485068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] RBAC: Authorizing `identity:get_user(user_id=21cc952fedba4dd197d34f102a343623)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.486777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.489046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 121/232] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:07 2022] GET /identity/v3/users/21cc952fedba4dd197d34f102a343623 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:07.495940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:07.635457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19ef8a-21ba-44c0-b464-550f58bd305d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.664072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:07.673948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847ae04-99d7-465e-a9bd-2fa5f46510e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.674616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847ae04-99d7-465e-a9bd-2fa5f46510e2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.674934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847ae04-99d7-465e-a9bd-2fa5f46510e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.675212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847ae04-99d7-465e-a9bd-2fa5f46510e2 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.676350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847ae04-99d7-465e-a9bd-2fa5f46510e2 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.677905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847ae04-99d7-465e-a9bd-2fa5f46510e2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.679920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 112/233] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:07 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:07.685362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:07.779167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:07.826182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c129d-c4b9-4ea9-810f-7367cd01a854 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:07.868798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526df7-41ea-4fbf-bf2f-d29d146f6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:07.869772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526df7-41ea-4fbf-bf2f-d29d146f6715 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:07.870217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526df7-41ea-4fbf-bf2f-d29d146f6715 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:07.870741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526df7-41ea-4fbf-bf2f-d29d146f6715 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2/users/21cc952fedba4dd197d34f102a343623/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:07.874510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d526df7-41ea-4fbf-bf2f-d29d146f6715 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b001a834b944749a246332386bc50a2, user_id=21cc952fedba4dd197d34f102a343623, role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:07.876171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d526df7-41ea-4fbf-bf2f-d29d146f6715 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:07.893316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 122/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:07 2022] PUT /identity/v3/projects/1b001a834b944749a246332386bc50a2/users/21cc952fedba4dd197d34f102a343623/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:16:08.904414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b635-eff3-4b0a-af25-be724cd402aa None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:08.904906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b635-eff3-4b0a-af25-be724cd402aa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:08.904906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b635-eff3-4b0a-af25-be724cd402aa None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:08.906209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 113/235] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:08.911922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8211d-cc4b-4fad-9d80-9a227cde87a2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:08.912798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8211d-cc4b-4fad-9d80-9a227cde87a2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:08.913256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8211d-cc4b-4fad-9d80-9a227cde87a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:08.931692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9af8211d-cc4b-4fad-9d80-9a227cde87a2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:08.933188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9af8211d-cc4b-4fad-9d80-9a227cde87a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:09.022131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 123/236] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:09.066518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce83acb-3613-4e83-9027-4483edd0f15e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:09.067185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce83acb-3613-4e83-9027-4483edd0f15e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:09.067650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce83acb-3613-4e83-9027-4483edd0f15e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:09.069190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 114/237] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:09.084363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340db44a-508a-4259-bbac-3ecbcf2d5ecf None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:09.084950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340db44a-508a-4259-bbac-3ecbcf2d5ecf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:09.085442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340db44a-508a-4259-bbac-3ecbcf2d5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:09.111155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-340db44a-508a-4259-bbac-3ecbcf2d5ecf None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:09.112790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-340db44a-508a-4259-bbac-3ecbcf2d5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:09.163625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:09.182375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 124/238] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:09.361567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce83acb-3613-4e83-9027-4483edd0f15e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:09.469587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340db44a-508a-4259-bbac-3ecbcf2d5ecf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:09.498041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce83acb-3613-4e83-9027-4483edd0f15e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:09.557796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:09.558445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:09.558717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:09.559006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:09.560152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:09.561632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:09.564652 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 115/239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:09.568900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:09.636373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340db44a-508a-4259-bbac-3ecbcf2d5ecf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:09.673112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:09.674139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:09.674639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:09.675126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:09.686446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:09.691798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:09.692987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:09.694347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:09.695512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:09.697834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 125/240] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:09.703233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:09.775265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:09.776060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24805ae-e7db-498c-8382-d78967d11e3e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:09.854366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:09.855041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:09.855321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:09.855591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:09.856277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:09.858051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:09.877777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0409-4f85-4b4b-b68c-fa642e22a56d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:09.901812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 116/241] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:09 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:16:09.946646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c988d8-988c-4d17-b0e3-3ba65e968c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:09.947326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c988d8-988c-4d17-b0e3-3ba65e968c69 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:09.947585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c988d8-988c-4d17-b0e3-3ba65e968c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:09.947859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c988d8-988c-4d17-b0e3-3ba65e968c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:09.948550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c988d8-988c-4d17-b0e3-3ba65e968c69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:09.949003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c988d8-988c-4d17-b0e3-3ba65e968c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:09.950419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c988d8-988c-4d17-b0e3-3ba65e968c69 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:09.965463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 126/242] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:09.971253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:10.052583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e6e73-d270-42c1-a151-4e00589121e3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.053178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e6e73-d270-42c1-a151-4e00589121e3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.053646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e6e73-d270-42c1-a151-4e00589121e3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.056199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 127/243] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:10.063126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be75cd-6bf7-4f83-9814-4f3f572415ed None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.063761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be75cd-6bf7-4f83-9814-4f3f572415ed None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.064223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be75cd-6bf7-4f83-9814-4f3f572415ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.088073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e4be75cd-6bf7-4f83-9814-4f3f572415ed None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:10.090150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e4be75cd-6bf7-4f83-9814-4f3f572415ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:10.162249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1491aa-0d80-4fbc-a02d-66d544e6e167 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:10.184868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:10.209595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:10.210248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.210525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.210805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] PATH_INFO: `/v3/users/02a88c2fedfb4ffba08c6667de3a071b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.217676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 128/244] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:10.225002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799812-ecdc-4c72-b872-4110e0ce1586 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.225281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799812-ecdc-4c72-b872-4110e0ce1586 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.225558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799812-ecdc-4c72-b872-4110e0ce1586 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.227242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 129/245] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:10.227381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] RBAC: Authorizing `identity:get_user(user_id=02a88c2fedfb4ffba08c6667de3a071b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:10.229057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:10.231267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 117/246] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:09 2022] GET /identity/v3/users/02a88c2fedfb4ffba08c6667de3a071b => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:10.236207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26149dc6-e9c0-4185-a40c-7beb01112155 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.237130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:10.238334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26149dc6-e9c0-4185-a40c-7beb01112155 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.239248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26149dc6-e9c0-4185-a40c-7beb01112155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.258630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-26149dc6-e9c0-4185-a40c-7beb01112155 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:10.260142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-26149dc6-e9c0-4185-a40c-7beb01112155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:10.292790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:10.336833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 130/247] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:10.369316 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18662b2c-2a9a-417b-b611-a0d21b8e3e17 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:10.405588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f750071-9cf6-4644-82ca-0d6340623a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:10.406453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750071-9cf6-4644-82ca-0d6340623a49 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.406896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750071-9cf6-4644-82ca-0d6340623a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.407412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750071-9cf6-4644-82ca-0d6340623a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.471774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:10.502966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f750071-9cf6-4644-82ca-0d6340623a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:10.504708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f750071-9cf6-4644-82ca-0d6340623a49 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:10.546092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26149dc6-e9c0-4185-a40c-7beb01112155 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:10.634154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 118/248] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:10.635809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1619812-9ff3-4c2c-888f-06f582b9cc27 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.636290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1619812-9ff3-4c2c-888f-06f582b9cc27 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.636752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1619812-9ff3-4c2c-888f-06f582b9cc27 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.638461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 119/249] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:10.639405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1619812-9ff3-4c2c-888f-06f582b9cc27 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:10.680472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26149dc6-e9c0-4185-a40c-7beb01112155 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:10.717146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:10.717784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.718056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.718328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.728893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:10.729387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:10.733919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:10.735066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 131/250] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:10.736051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:10.761521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1619812-9ff3-4c2c-888f-06f582b9cc27 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:10.768178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:10.804725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156d21f-406d-4904-b39a-6224b226bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:10.806187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156d21f-406d-4904-b39a-6224b226bb4d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.806599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156d21f-406d-4904-b39a-6224b226bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.807002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156d21f-406d-4904-b39a-6224b226bb4d None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.808914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156d21f-406d-4904-b39a-6224b226bb4d None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:10.810562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156d21f-406d-4904-b39a-6224b226bb4d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:10.813132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 120/251] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:10 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:10.814597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57328e9-fb15-49b3-b740-6d9be6ff6655 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.815033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57328e9-fb15-49b3-b740-6d9be6ff6655 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.815417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57328e9-fb15-49b3-b740-6d9be6ff6655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.838783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d57328e9-fb15-49b3-b740-6d9be6ff6655 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:10.840462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d57328e9-fb15-49b3-b740-6d9be6ff6655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:10.852355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b386b-a000-406e-9030-3ad62645ca46 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:10.891128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:10.891680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:10.891950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:10.892223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:10.904400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:10.909702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:10.910619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:10.911537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 132/252] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:10.913462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:10.934411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 121/253] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:10.935670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57328e9-fb15-49b3-b740-6d9be6ff6655 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.008710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:11.015461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:11.026982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97505be-e072-494b-8d3d-1186a98fe570 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:11.049398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57328e9-fb15-49b3-b740-6d9be6ff6655 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:11.065928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:11.066551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:11.066838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:11.067326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:11.068269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:11.068581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:11.069971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:11.080090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 133/254] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:11.080983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.086736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:11.087436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:11.087713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:11.087985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:11.088815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] RBAC: Adding query filter params (role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=02a88c2fedfb4ffba08c6667de3a071b) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:11.089120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:11.090901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:11.097607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 122/255] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:10 2022] GET /identity/v3/role_assignments?user.id=02a88c2fedfb4ffba08c6667de3a071b&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:11.098462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.309466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591118e-195d-4fd0-b10d-d403856e065d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:11.333846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698f63-ea50-4464-ae86-3f428d807b40 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:11.386934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:11.387562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:11.387841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:11.388118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:11.388796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:11.389099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:11.390499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:11.404916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:11.405573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:11.405850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:11.406122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] PATH_INFO: `/v3/users/21cc952fedba4dd197d34f102a343623` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:11.407475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] RBAC: Authorizing `identity:get_user(user_id=21cc952fedba4dd197d34f102a343623)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:11.408931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:11.412660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 134/256] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:11.412987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 123/257] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:11 2022] GET /identity/v3/users/21cc952fedba4dd197d34f102a343623 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:11.418218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.419526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.428865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:11.446012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:11.545215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aaa2d6-fc56-4ec8-ba52-2eced9ba7d46 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:11.578154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b25fbc-d8b5-4e34-81bf-202f685a153e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:11.581693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:11.582367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:11.582684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:11.582986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] PATH_INFO: `/v3/users/d41803c350234fee88082cf65eb46dd4` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:11.584167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] RBAC: Authorizing `identity:get_user(user_id=d41803c350234fee88082cf65eb46dd4)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:11.585682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:11.587844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 124/258] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:11 2022] GET /identity/v3/users/d41803c350234fee88082cf65eb46dd4 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:11.588775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.630715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:11.631383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:11.632133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:11.632133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:11.668526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:11.701763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660e1e-5043-4eca-8922-63d091092d97 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:11.751200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:11.751843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:11.752117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:11.752385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:11.763804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:11.765280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:11.777638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:11.785289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:11.787500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:11.789435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:11.791170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 125/259] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:11.794845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.795052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:11.930145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 135/260] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:11.931047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:11.991007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e4131-d95d-45eb-bb6a-5d67124423b8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:12.022068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:12.035509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:12.036268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.036603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.036873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.038077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:12.039591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:12.041237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 126/261] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:11 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:12.041982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:12.168814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ebdf-3d1a-4b50-8fe3-01182f5f4566 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:12.183264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a873f-27c8-4bb1-bebe-bc65d8ba687d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:12.203178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:12.218388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:12.219663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.220076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.220536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.227522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:12.229122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:12.230927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 127/262] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:12 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:12.234020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:12.262680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:12.263650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.266257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.266738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.267626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:12.268440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:12.272172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:12.292309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 136/263] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:12.293385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:12.361453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:12.399322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f581-c9c8-4ab3-87d3-a1272c8a6cbc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:12.436248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:12.437349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.437918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.438357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2/users/d41803c350234fee88082cf65eb46dd4/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.440955 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] RBAC: Authorizing `identity:create_grant(project_id=1b001a834b944749a246332386bc50a2, user_id=d41803c350234fee88082cf65eb46dd4, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:12.442796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:12.460103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 128/264] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:12 2022] PUT /identity/v3/projects/1b001a834b944749a246332386bc50a2/users/d41803c350234fee88082cf65eb46dd4/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:12.461284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:12.578468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9e19f-744c-4aa5-8bed-c70dfe8ba5ca None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:12.604881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ef126-d1d5-4f88-ab36-2a57162cae1b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:12.617991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:12.619069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.619567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.620767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] PATH_INFO: `/v3/users/21cc952fedba4dd197d34f102a343623` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.622387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] RBAC: Authorizing `identity:get_user(user_id=21cc952fedba4dd197d34f102a343623)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:12.624828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:12.626923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 129/265] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:12 2022] GET /identity/v3/users/21cc952fedba4dd197d34f102a343623 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:12.631405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:12.638436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:12.714167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173de68b-f530-41ad-8043-df5d42207501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:12.715192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de68b-f530-41ad-8043-df5d42207501 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.715927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de68b-f530-41ad-8043-df5d42207501 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.717268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de68b-f530-41ad-8043-df5d42207501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.718322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173de68b-f530-41ad-8043-df5d42207501 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=21cc952fedba4dd197d34f102a343623) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:12.719012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173de68b-f530-41ad-8043-df5d42207501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:12.720696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173de68b-f530-41ad-8043-df5d42207501 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:12.746339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 137/266] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:12 2022] GET /identity/v3/role_assignments?user.id=21cc952fedba4dd197d34f102a343623&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:12.803077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01c330-209b-4444-91f4-13f33db2bd4d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:12.843438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:12.844347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.844763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.845168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.894093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a684f-183f-4b8b-b0ae-59f88303cc64 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.894427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a684f-183f-4b8b-b0ae-59f88303cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.894605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a684f-183f-4b8b-b0ae-59f88303cc64 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.898028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 138/267] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:12.908255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce68d-d3c5-4ac7-b65b-913710ec60f9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:12.908699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce68d-d3c5-4ac7-b65b-913710ec60f9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:12.909065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce68d-d3c5-4ac7-b65b-913710ec60f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:12.926580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:12.948043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:12.950525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:12.953683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ba5ce68d-d3c5-4ac7-b65b-913710ec60f9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:12.955352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ba5ce68d-d3c5-4ac7-b65b-913710ec60f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:13.048318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:13.095668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 139/268] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:13.096919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039ce35-1c79-45bb-a771-e1753facad8f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:13.097208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039ce35-1c79-45bb-a771-e1753facad8f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:13.097479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039ce35-1c79-45bb-a771-e1753facad8f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:13.098868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 140/269] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:13.104739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371aa14-3ed7-40a7-98a7-ccd6757d47f2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:13.105001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371aa14-3ed7-40a7-98a7-ccd6757d47f2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:13.105279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371aa14-3ed7-40a7-98a7-ccd6757d47f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:13.120191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 130/270] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 07:16:13.126171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:13.128224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a371aa14-3ed7-40a7-98a7-ccd6757d47f2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:13.129417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a371aa14-3ed7-40a7-98a7-ccd6757d47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:13.253428 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 141/271] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:13.271282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:13.275853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb85848-a963-4527-80dc-af6b1b2b6333 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:13.311338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:13.311903 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:13.312175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:13.312488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:13.313627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:13.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:13.317200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 131/272] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:13 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:13.323505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371aa14-3ed7-40a7-98a7-ccd6757d47f2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:13.421555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:13.428158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371aa14-3ed7-40a7-98a7-ccd6757d47f2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:13.462282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:13.463262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:13.463705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:13.464137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:13.465023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] RBAC: Adding query filter params (role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=21cc952fedba4dd197d34f102a343623) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:13.465523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:13.467220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:13.474062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 142/273] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:13 2022] GET /identity/v3/role_assignments?user.id=21cc952fedba4dd197d34f102a343623&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:13.571425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:13.652603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:13.765795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845f7b7-1d0a-4db2-9592-5d79895b62f1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:13.775730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5d970-b17f-4ff5-8075-611586c1ecd6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:13.813956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:13.814645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:13.814952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:13.815220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:13.816511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:13.818649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:13.821000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 143/274] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:13.827220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:13.829697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:13.830352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:13.830630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:13.830927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:13.841715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:13.846596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:13.847514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:13.848491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:13.851229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 132/275] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:13.858294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:13.858958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:13.888411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:13.950642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f0764-a637-4999-908f-09ef5de3b5cf None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:13.987596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda4e7-3863-4aab-93a8-244318c05619 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:13.989126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:13.989951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:13.990325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:13.990712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:13.991519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:13.993138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:14.018896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 144/276] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:13 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:16:14.031333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26699d-ab08-42c1-8667-76f9a85ef3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:14.031984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26699d-ab08-42c1-8667-76f9a85ef3fa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:14.032271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26699d-ab08-42c1-8667-76f9a85ef3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:14.032589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26699d-ab08-42c1-8667-76f9a85ef3fa None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:14.033337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26699d-ab08-42c1-8667-76f9a85ef3fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:14.033645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26699d-ab08-42c1-8667-76f9a85ef3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:14.035219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26699d-ab08-42c1-8667-76f9a85ef3fa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:14.045541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 133/277] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:14.051935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:14.080797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353591ad-2fff-428a-a066-baf6ba50578e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:14.080978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353591ad-2fff-428a-a066-baf6ba50578e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:14.081300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353591ad-2fff-428a-a066-baf6ba50578e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:14.086859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 134/278] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:14.089450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17418-66b3-4cc0-bb97-177059c0d220 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:14.089729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17418-66b3-4cc0-bb97-177059c0d220 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:14.089998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17418-66b3-4cc0-bb97-177059c0d220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:14.113601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-dbe17418-66b3-4cc0-bb97-177059c0d220 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:14.115545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dbe17418-66b3-4cc0-bb97-177059c0d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:14.156525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:14.179325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83276d-8a4e-498a-9ee1-82b829275e5c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:14.218847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 135/279] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:14.226364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:14.227054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:14.227335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:14.227605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] PATH_INFO: `/v3/users/35a2ab7f78944e3292d2c87a23189e2e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:14.243304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] RBAC: Authorizing `identity:get_user(user_id=35a2ab7f78944e3292d2c87a23189e2e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:14.244424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:14.246242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 145/280] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:14 2022] GET /identity/v3/users/35a2ab7f78944e3292d2c87a23189e2e => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:14.252073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17418-66b3-4cc0-bb97-177059c0d220 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:14.272558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:14.360765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17418-66b3-4cc0-bb97-177059c0d220 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:14.399116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:14.400158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:14.400655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:14.401106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:14.402024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, user.id=35a2ab7f78944e3292d2c87a23189e2e, scope.system=all) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:14.402517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:14.404228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:14.411966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 136/281] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 15 07:16:14 2022] GET /identity/v3/role_assignments?user.id=35a2ab7f78944e3292d2c87a23189e2e&scope.system=all&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:14.483117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:14.597894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5862f-c455-4f95-9d78-86df375a40fb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:14.635234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:14.635881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:14.636153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:14.636418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:14.647168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:14.651950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:14.652806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:14.653594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 146/282] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:14.659943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:14.771005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:14.796689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95101-6776-469d-b644-21cce42b4659 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:14.843703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:14.844718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:14.845188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:14.845649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:14.846525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:14.847047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:14.848763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:14.869090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 137/283] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:14.875069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:14.881730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:15.005155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf77c80-8be4-4c88-b926-9723286646c7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:15.044508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed510e2e-b85f-41b3-9ed5-bdac1e50d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:15.045163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510e2e-b85f-41b3-9ed5-bdac1e50d7de None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:15.045717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510e2e-b85f-41b3-9ed5-bdac1e50d7de None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:15.045986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510e2e-b85f-41b3-9ed5-bdac1e50d7de None admin] PATH_INFO: `/v3/users/02a88c2fedfb4ffba08c6667de3a071b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:15.047154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed510e2e-b85f-41b3-9ed5-bdac1e50d7de None admin] RBAC: Authorizing `identity:get_user(user_id=02a88c2fedfb4ffba08c6667de3a071b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:15.048619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed510e2e-b85f-41b3-9ed5-bdac1e50d7de None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:15.050600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 147/284] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:14 2022] GET /identity/v3/users/02a88c2fedfb4ffba08c6667de3a071b => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:15.056517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:15.196536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df374-86c2-410a-83f9-542edc341263 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:15.197203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df374-86c2-410a-83f9-542edc341263 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:15.197670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df374-86c2-410a-83f9-542edc341263 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:15.199821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 148/285] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:15.205419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67be6c-9f9f-4017-9568-4f9eb64c5ee7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:15.206062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67be6c-9f9f-4017-9568-4f9eb64c5ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:15.206790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67be6c-9f9f-4017-9568-4f9eb64c5ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:15.225893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0b67be6c-9f9f-4017-9568-4f9eb64c5ee7 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:15.226580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc0f4f-0bba-42f6-8b84-2e37183677ad None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:15.227976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0b67be6c-9f9f-4017-9568-4f9eb64c5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:15.290548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:15.291527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:15.293433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:15.294759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:15.296378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:15.299734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:15.303972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 138/286] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:15 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:15.319092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:15.331180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:15.340618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:15.347786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 149/287] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:15.469780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faa7f6-008f-4660-993f-a776a11211bf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:15.517309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:15.518325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:15.518796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:15.519282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2/users/02a88c2fedfb4ffba08c6667de3a071b/roles/c6074ceff02c4ce8b1e81d0ccdc65dd9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:15.521517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b001a834b944749a246332386bc50a2, user_id=02a88c2fedfb4ffba08c6667de3a071b, role_id=c6074ceff02c4ce8b1e81d0ccdc65dd9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:15.523227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:15.544115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 139/288] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:15 2022] PUT /identity/v3/projects/1b001a834b944749a246332386bc50a2/users/02a88c2fedfb4ffba08c6667de3a071b/roles/c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:15.633154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67be6c-9f9f-4017-9568-4f9eb64c5ee7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:15.738525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67be6c-9f9f-4017-9568-4f9eb64c5ee7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:15.774380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:15.775062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:15.775339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:15.775625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:15.785985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:15.790932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:15.791826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:15.792703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:15.797243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 150/289] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:15.798811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:15.884038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:15.918050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb300a7-73dc-43ee-8de3-22ab655456e3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:15.953083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:15.953712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:15.953989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:15.954260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:15.954965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:15.955276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:15.956795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:15.968756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 140/290] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:15.971910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:16.036287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:16.083658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6449f-dd46-460e-85d1-6350f4794428 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:16.120558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:16.121198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:16.121474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:16.121748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] PATH_INFO: `/v3/users/d41803c350234fee88082cf65eb46dd4` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:16.122909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] RBAC: Authorizing `identity:get_user(user_id=d41803c350234fee88082cf65eb46dd4)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:16.124426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:16.126020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 151/291] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:15 2022] GET /identity/v3/users/d41803c350234fee88082cf65eb46dd4 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:16.131903 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:16.255729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7857e-1e08-4058-aa1c-57735ced1401 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:16.286710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:16.291746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:16.292293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:16.292951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:16.293227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:16.383092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:16.384686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:16.505262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 141/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:16.512350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:16.653370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330d25-bd31-4eb8-919b-1a1aed854961 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:16.690634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:16.699092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7561b4-fdee-4656-a4bc-bb20ef995a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:16.699794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7561b4-fdee-4656-a4bc-bb20ef995a89 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:16.700077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7561b4-fdee-4656-a4bc-bb20ef995a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:16.700350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7561b4-fdee-4656-a4bc-bb20ef995a89 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:16.707579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7561b4-fdee-4656-a4bc-bb20ef995a89 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:16.709104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7561b4-fdee-4656-a4bc-bb20ef995a89 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:16.710923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 152/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:16 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:16.716978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:16.758477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:16.836674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076627f5-085c-4ea0-98d7-56c0b0d8e5c1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:16.882481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f696d-240d-4402-a0fb-97ced779fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:16.883583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f696d-240d-4402-a0fb-97ced779fce8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:16.884032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f696d-240d-4402-a0fb-97ced779fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:16.884469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f696d-240d-4402-a0fb-97ced779fce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:16.885400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f696d-240d-4402-a0fb-97ced779fce8 None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=d41803c350234fee88082cf65eb46dd4) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:16.885874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f696d-240d-4402-a0fb-97ced779fce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:16.887521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f696d-240d-4402-a0fb-97ced779fce8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:16.894282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 142/294] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:16 2022] GET /identity/v3/role_assignments?user.id=d41803c350234fee88082cf65eb46dd4&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:16.975044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6052-8098-4172-b24c-91bb1e75f8a8 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:16.975344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6052-8098-4172-b24c-91bb1e75f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:16.975601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6052-8098-4172-b24c-91bb1e75f8a8 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:16.977407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 153/295] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:16.983046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfffb-b686-4689-ae60-dd66b3600ad6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:16.983641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfffb-b686-4689-ae60-dd66b3600ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:16.984116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfffb-b686-4689-ae60-dd66b3600ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.016190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-dc0bfffb-b686-4689-ae60-dd66b3600ad6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:17.017880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dc0bfffb-b686-4689-ae60-dd66b3600ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:17.120069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c2dfd-cb7a-4f38-84f6-1945d4b0bbf5 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.120344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c2dfd-cb7a-4f38-84f6-1945d4b0bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.120804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c2dfd-cb7a-4f38-84f6-1945d4b0bbf5 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.122031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 143/296] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:17.123419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 154/297] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:17.132408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae261-6eec-4b98-82cc-cca6be967952 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.132743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae261-6eec-4b98-82cc-cca6be967952 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.132954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae261-6eec-4b98-82cc-cca6be967952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.151220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-000ae261-6eec-4b98-82cc-cca6be967952 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:17.152406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-000ae261-6eec-4b98-82cc-cca6be967952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:17.175746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:17.226220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 144/298] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:17.313751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8088b7-c3ab-4365-85d1-b88ccbb84e8a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.314030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8088b7-c3ab-4365-85d1-b88ccbb84e8a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.314457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8088b7-c3ab-4365-85d1-b88ccbb84e8a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.316052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 155/299] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:17.322439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bef86-fc1d-48da-983b-248d7dcc9b55 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.323337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bef86-fc1d-48da-983b-248d7dcc9b55 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.323821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bef86-fc1d-48da-983b-248d7dcc9b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.342610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7f1bef86-fc1d-48da-983b-248d7dcc9b55 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:17.343840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7f1bef86-fc1d-48da-983b-248d7dcc9b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:17.414280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8088b7-c3ab-4365-85d1-b88ccbb84e8a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:17.431319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 145/300] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:17.527708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8088b7-c3ab-4365-85d1-b88ccbb84e8a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:17.545636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bef86-fc1d-48da-983b-248d7dcc9b55 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:17.565588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:17.566225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.566500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.566773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.567951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:17.569564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:17.571762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 156/301] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:17.576859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:17.651198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:17.655543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:17.674555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bef86-fc1d-48da-983b-248d7dcc9b55 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:17.693002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8df43-eb3a-4e5b-b3f5-67afecd46335 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:17.713890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:17.714952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.715419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.715876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.727018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:17.728760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:17.729382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.729658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.729931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] PATH_INFO: `/v3/groups` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.730571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:17.732057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:17.733684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:17.734525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:17.735374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:17.740900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 146/302] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:17.740900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:17.752861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 157/303] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Sep 15 07:16:17 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:17.754989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:17.855310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7696-8bec-4b3b-8172-ba5c1499c8d5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:17.895158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:17.896069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.896487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.896926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.908242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb31e1-64c7-4308-99e8-29c0cbc86f19 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:17.909708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:17.915863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:17.917022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:17.918012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:17.920637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 147/304] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:17.926173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:17.938517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:17.942274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:17.957898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:17.958712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:17.959080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:17.959469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:17.960214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:17.960606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:17.962169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:17.976100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 158/305] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:17.983142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:18.053367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e1445-bb05-42e3-9ae8-a9a197cc80fb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:18.097241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:18.098102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.098418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.100131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.100833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:18.101145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:18.102543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:18.111104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fb1c5-7620-4e93-8bf5-a412e26984ae None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:18.111246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 148/306] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:18.118910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:18.155807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:18.156690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.157227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.157632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] PATH_INFO: `/v3/users/bf61a7932b694fb7a962fd9b1fc739f9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.173263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61a7932b694fb7a962fd9b1fc739f9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:18.175003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:18.177467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 159/307] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:17 2022] GET /identity/v3/users/bf61a7932b694fb7a962fd9b1fc739f9 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:18.183400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:18.198760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:18.240782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b88fc0-5627-4370-a876-41665df02fac None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:18.270873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:18.277567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:18.278348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.278681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.279014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] PATH_INFO: `/v3/users/35a2ab7f78944e3292d2c87a23189e2e` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.280147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] RBAC: Authorizing `identity:get_user(user_id=35a2ab7f78944e3292d2c87a23189e2e)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:18.282163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:18.286866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 149/308] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:18 2022] GET /identity/v3/users/35a2ab7f78944e3292d2c87a23189e2e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:18.290907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:18.316099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb644d-4e5f-4f96-afb6-152ea8157b43 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:18.354552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755a9b-735a-4e72-bd37-9928a68ebad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:18.355192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755a9b-735a-4e72-bd37-9928a68ebad3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.355465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755a9b-735a-4e72-bd37-9928a68ebad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.356033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755a9b-735a-4e72-bd37-9928a68ebad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.356444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755a9b-735a-4e72-bd37-9928a68ebad3 None admin] RBAC: Adding query filter params (role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9, user.id=bf61a7932b694fb7a962fd9b1fc739f9, scope.system=all) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:18.356746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755a9b-735a-4e72-bd37-9928a68ebad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:18.358176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755a9b-735a-4e72-bd37-9928a68ebad3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:18.363272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 160/309] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 15 07:16:18 2022] GET /identity/v3/role_assignments?user.id=bf61a7932b694fb7a962fd9b1fc739f9&scope.system=all&role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:18.367640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f30f-fc44-4f1d-87c5-29bdf86cdb5c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.367640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f30f-fc44-4f1d-87c5-29bdf86cdb5c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.367640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f30f-fc44-4f1d-87c5-29bdf86cdb5c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.367640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 161/310] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:18.372043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d683d-c0fa-467a-a61c-76ee73fabbf2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.372322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d683d-c0fa-467a-a61c-76ee73fabbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.372591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d683d-c0fa-467a-a61c-76ee73fabbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.394045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c77d683d-c0fa-467a-a61c-76ee73fabbf2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:18.395415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c77d683d-c0fa-467a-a61c-76ee73fabbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:18.414626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1b217-0adb-4eac-83d9-c9f87e212e2a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:18.456695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:18.457518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.457898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.458263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] PATH_INFO: `/v3/system/users/35a2ab7f78944e3292d2c87a23189e2e/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.460816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=35a2ab7f78944e3292d2c87a23189e2e, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:18.463120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:18.468698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:18.483167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 150/312] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Sep 15 07:16:18 2022] PUT /identity/v3/system/users/35a2ab7f78944e3292d2c87a23189e2e/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:18.483416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 162/312] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:18.743000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:18.844884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e23b3-7a19-4265-8a01-edc06989f4de None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:18.886857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:18.887502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:18.887780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:18.888049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:18.899086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:18.905248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:18.906129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:18.906948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 151/313] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:18.913990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d683d-c0fa-467a-a61c-76ee73fabbf2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:18.956517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:19.021783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d683d-c0fa-467a-a61c-76ee73fabbf2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:19.058847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:19.059469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:19.059741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:19.060006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:19.060677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:19.060974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:19.062490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:19.071416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 163/314] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:19.079940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:19.142744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:19.189034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4411e-9c70-4e9b-b455-586dd06a2851 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:19.223861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:19.224860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:19.225137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:19.225409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] PATH_INFO: `/v3/users/02a88c2fedfb4ffba08c6667de3a071b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:19.226558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] RBAC: Authorizing `identity:get_user(user_id=02a88c2fedfb4ffba08c6667de3a071b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:19.228053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:19.229968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 152/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:19 2022] GET /identity/v3/users/02a88c2fedfb4ffba08c6667de3a071b => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:19.235473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:19.342061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:19.345960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab96cb-2955-4328-947f-bb3360ec5a17 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:19.381304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:19.382256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:19.382729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:19.383189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:19.450180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:19.452090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:19.552584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 164/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:19.557511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:19.558957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:19.676008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5d9f1-43e9-4ae1-a430-3477e27bb68e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:19.703272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:19.712250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375d5f-5771-4543-947b-15101bdafda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:19.713361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375d5f-5771-4543-947b-15101bdafda3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:19.713641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375d5f-5771-4543-947b-15101bdafda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:19.713911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375d5f-5771-4543-947b-15101bdafda3 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:19.715139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d375d5f-5771-4543-947b-15101bdafda3 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:19.716609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d375d5f-5771-4543-947b-15101bdafda3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:19.718408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 153/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:19 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:19.725043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:19.823119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef497689-1203-4ce7-b786-76bc783d7fa5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:19.858101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123c4bf-7c9d-400e-9284-9e714cb79909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:19.859089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c4bf-7c9d-400e-9284-9e714cb79909 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:19.859580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c4bf-7c9d-400e-9284-9e714cb79909 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:19.860067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c4bf-7c9d-400e-9284-9e714cb79909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:19.860978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123c4bf-7c9d-400e-9284-9e714cb79909 None admin] RBAC: Adding query filter params (role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9, scope.project.id=1b001a834b944749a246332386bc50a2, user.id=02a88c2fedfb4ffba08c6667de3a071b) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:19.861484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123c4bf-7c9d-400e-9284-9e714cb79909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:19.863132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123c4bf-7c9d-400e-9284-9e714cb79909 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:19.869572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 165/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:19 2022] GET /identity/v3/role_assignments?user.id=02a88c2fedfb4ffba08c6667de3a071b&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:20.013387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1211de-d37b-45af-aa99-8fe3cb7bdd29 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.013685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1211de-d37b-45af-aa99-8fe3cb7bdd29 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.013857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1211de-d37b-45af-aa99-8fe3cb7bdd29 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.015586 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 154/319] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:20.021595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d742f7-700e-4d39-97a2-c00daa29a0ad None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.022193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d742f7-700e-4d39-97a2-c00daa29a0ad None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.022193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d742f7-700e-4d39-97a2-c00daa29a0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.041668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-21d742f7-700e-4d39-97a2-c00daa29a0ad None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:20.042935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-21d742f7-700e-4d39-97a2-c00daa29a0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:20.105026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:20.115324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 166/320] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:20.380637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1211de-d37b-45af-aa99-8fe3cb7bdd29 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:20.491476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1211de-d37b-45af-aa99-8fe3cb7bdd29 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:20.525186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2f77-4d4c-4f95-b990-980f3c6c4efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:20.525827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2f77-4d4c-4f95-b990-980f3c6c4efa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.526101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2f77-4d4c-4f95-b990-980f3c6c4efa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.526382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2f77-4d4c-4f95-b990-980f3c6c4efa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.527518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2f77-4d4c-4f95-b990-980f3c6c4efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:20.529018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2f77-4d4c-4f95-b990-980f3c6c4efa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:20.534923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 155/321] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:20.536665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d742f7-700e-4d39-97a2-c00daa29a0ad None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:20.561044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f262da-e5f2-438f-84c2-0e940609b66b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.561558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f262da-e5f2-438f-84c2-0e940609b66b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.561558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f262da-e5f2-438f-84c2-0e940609b66b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.562938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 156/322] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:20.567897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf09a-3a72-4d56-9844-526874a48b62 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.568215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf09a-3a72-4d56-9844-526874a48b62 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.568444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf09a-3a72-4d56-9844-526874a48b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.586210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9b5cf09a-3a72-4d56-9844-526874a48b62 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:20.587435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9b5cf09a-3a72-4d56-9844-526874a48b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:20.647763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d742f7-700e-4d39-97a2-c00daa29a0ad None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:20.651460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:20.661785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 157/323] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:20.681791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435b2c-1cd3-40aa-821f-6a70a44fabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:20.682414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435b2c-1cd3-40aa-821f-6a70a44fabca None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.682689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435b2c-1cd3-40aa-821f-6a70a44fabca None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.682994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435b2c-1cd3-40aa-821f-6a70a44fabca None admin] PATH_INFO: `/v3/groups` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.683645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce435b2c-1cd3-40aa-821f-6a70a44fabca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:20.685107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce435b2c-1cd3-40aa-821f-6a70a44fabca None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:20.703125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 167/324] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Sep 15 07:16:20 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:20.822279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ffb8a-f2a5-4a34-8972-3a601e986949 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.822647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ffb8a-f2a5-4a34-8972-3a601e986949 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.822810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ffb8a-f2a5-4a34-8972-3a601e986949 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.824231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 158/325] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:20.830404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bcb9-6062-45ed-b638-6a0c2a662c4f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:20.830740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bcb9-6062-45ed-b638-6a0c2a662c4f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:20.831007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66bcb9-6062-45ed-b638-6a0c2a662c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:20.851262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ad66bcb9-6062-45ed-b638-6a0c2a662c4f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:20.852484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ad66bcb9-6062-45ed-b638-6a0c2a662c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:20.908715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:20.926327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ffb8a-f2a5-4a34-8972-3a601e986949 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:20.928427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 168/326] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:21.039837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ffb8a-f2a5-4a34-8972-3a601e986949 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.079325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.080346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.080829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.081280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.093519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:21.098792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:21.100140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:21.101035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:21.102934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 159/327] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:21.108874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66bcb9-6062-45ed-b638-6a0c2a662c4f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:21.191682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:21.221871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66bcb9-6062-45ed-b638-6a0c2a662c4f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.262731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:21.269616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.269616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.269616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.269616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.272254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:21.273737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:21.277414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:21.287226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 169/328] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:21.292835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:21.323287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216f8a-e72e-4ae2-b0ac-d69b44296e24 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.345073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:21.365095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.366092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.366657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.367144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.379935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:21.386587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:21.387674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:21.388483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:21.395036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 160/329] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:21.397784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:21.403392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313257e-2af2-480b-a0c0-c9ed4c356177 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.440476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.441117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.441390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.441657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] PATH_INFO: `/v3/users/bf61a7932b694fb7a962fd9b1fc739f9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.442949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] RBAC: Authorizing `identity:get_user(user_id=bf61a7932b694fb7a962fd9b1fc739f9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:21.444337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:21.445935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 170/330] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:21 2022] GET /identity/v3/users/bf61a7932b694fb7a962fd9b1fc739f9 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:21.453080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:21.515248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912e9e0-a9e2-4956-aae6-4b8381d58364 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.533097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:21.558023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.559131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.559602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.560107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.560967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:21.561474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:21.563661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:21.565489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df296-2f17-4d50-84d6-fca490d2654e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.578991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 161/331] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:21.580884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:21.581696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:21.604307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.604969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.605242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.605835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] PATH_INFO: `/v3/system/users/bf61a7932b694fb7a962fd9b1fc739f9/roles/c6074ceff02c4ce8b1e81d0ccdc65dd9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.607393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bf61a7932b694fb7a962fd9b1fc739f9, role_id=c6074ceff02c4ce8b1e81d0ccdc65dd9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:21.608778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:21.620697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 171/332] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Sep 15 07:16:21 2022] PUT /identity/v3/system/users/bf61a7932b694fb7a962fd9b1fc739f9/roles/c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:16:21.715940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f67455-f9ab-433b-af42-c2563220d229 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.759778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e7ece-ea37-43a1-ad81-5f7726cfedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.760729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e7ece-ea37-43a1-ad81-5f7726cfedad None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.761151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e7ece-ea37-43a1-ad81-5f7726cfedad None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.761637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e7ece-ea37-43a1-ad81-5f7726cfedad None admin] PATH_INFO: `/v3/users/35a2ab7f78944e3292d2c87a23189e2e` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.763048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e7ece-ea37-43a1-ad81-5f7726cfedad None admin] RBAC: Authorizing `identity:get_user(user_id=35a2ab7f78944e3292d2c87a23189e2e)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:21.764805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e7ece-ea37-43a1-ad81-5f7726cfedad None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:21.769642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 162/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:21 2022] GET /identity/v3/users/35a2ab7f78944e3292d2c87a23189e2e => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:21.773784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:21.888225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559aac-6c54-49df-9d63-a7447a941dc2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:21.925203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff3bbe-4655-4de9-a389-17d6601eccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:21.926085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3bbe-4655-4de9-a389-17d6601eccd7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:21.926628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3bbe-4655-4de9-a389-17d6601eccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:21.927063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3bbe-4655-4de9-a389-17d6601eccd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:21.927924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff3bbe-4655-4de9-a389-17d6601eccd7 None admin] RBAC: Adding query filter params (role.id=b4bb394dff344761ba3dfd2d3be54ad7, user.id=35a2ab7f78944e3292d2c87a23189e2e, scope.system=all) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:21.928366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff3bbe-4655-4de9-a389-17d6601eccd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:21.929952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff3bbe-4655-4de9-a389-17d6601eccd7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:21.946548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 172/334] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 15 07:16:21 2022] GET /identity/v3/role_assignments?user.id=35a2ab7f78944e3292d2c87a23189e2e&scope.system=all&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:23.421085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684896-3521-47c4-bf52-0c88ca3a88a4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:23.421621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684896-3521-47c4-bf52-0c88ca3a88a4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:23.421621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684896-3521-47c4-bf52-0c88ca3a88a4 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:23.423361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 163/335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:23.429728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaa6d-551f-4f76-95ed-5f97ba8966f2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:23.430677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaa6d-551f-4f76-95ed-5f97ba8966f2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:23.431168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaaa6d-551f-4f76-95ed-5f97ba8966f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:23.455839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7bbaaa6d-551f-4f76-95ed-5f97ba8966f2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:23.457413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7bbaaa6d-551f-4f76-95ed-5f97ba8966f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:23.493238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:23.536659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 173/336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:23.681843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2df14-2d80-4711-bca9-421e6df2a98c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:23.682623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2df14-2d80-4711-bca9-421e6df2a98c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:23.683319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2df14-2d80-4711-bca9-421e6df2a98c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:23.685946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 164/337] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:23.691369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159431-627b-48c4-ab8c-1ff5830056e4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:23.691734 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159431-627b-48c4-ab8c-1ff5830056e4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:23.692080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159431-627b-48c4-ab8c-1ff5830056e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:23.713824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-76159431-627b-48c4-ab8c-1ff5830056e4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:23.719105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-76159431-627b-48c4-ab8c-1ff5830056e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:23.792306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 174/338] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:23.972042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2df14-2d80-4711-bca9-421e6df2a98c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:24.035364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:24.108558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2df14-2d80-4711-bca9-421e6df2a98c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:24.146954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:24.147942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:24.148405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:24.148859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:24.166270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:24.171157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:24.172029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:24.172859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 165/339] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:24.178745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159431-627b-48c4-ab8c-1ff5830056e4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:24.193534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:24.305185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:24.314362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159431-627b-48c4-ab8c-1ff5830056e4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:24.363151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:24.363919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:24.364222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:24.364491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:24.365286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:24.365618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:24.367018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:24.376776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 175/340] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:24.384222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:24.423452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea07a5-6687-4b3d-a4e1-16681e7f01df None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:24.427134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:24.485405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb040fd0-57a4-462b-bf0c-0b09687d8a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:24.486132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb040fd0-57a4-462b-bf0c-0b09687d8a33 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:24.486497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb040fd0-57a4-462b-bf0c-0b09687d8a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:24.486764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb040fd0-57a4-462b-bf0c-0b09687d8a33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:24.506505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb040fd0-57a4-462b-bf0c-0b09687d8a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-eb040fd0-57a4-462b-bf0c-0b09687d8a33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:24.514931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:24.515861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:24.517089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 166/341] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:24.517751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef6607-bcee-40f4-aee5-4cc068d781b4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:24.518024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef6607-bcee-40f4-aee5-4cc068d781b4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:24.519161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef6607-bcee-40f4-aee5-4cc068d781b4 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:24.523877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 167/342] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:24.524579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef6607-bcee-40f4-aee5-4cc068d781b4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:24.524807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfcca8-247b-424b-9235-8a278c54daa3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:24.570401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:24.570964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:24.571244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:24.571512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:24.607251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:24.658290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:24.659805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:24.702774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef6607-bcee-40f4-aee5-4cc068d781b4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:24.757938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bab176-3470-49c1-be12-a90997b85d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:24.758618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab176-3470-49c1-be12-a90997b85d01 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:24.758922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab176-3470-49c1-be12-a90997b85d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:24.759198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab176-3470-49c1-be12-a90997b85d01 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:24.760194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bab176-3470-49c1-be12-a90997b85d01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:24.760194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bab176-3470-49c1-be12-a90997b85d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:24.761552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bab176-3470-49c1-be12-a90997b85d01 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:24.785072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 168/343] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:24.786427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1120a8-c913-44e9-9bdd-8617e03ac75f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:24.786711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1120a8-c913-44e9-9bdd-8617e03ac75f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:24.787003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1120a8-c913-44e9-9bdd-8617e03ac75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:24.808681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 176/344] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:24.809930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:24.820264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3e1120a8-c913-44e9-9bdd-8617e03ac75f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:24.823924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3e1120a8-c913-44e9-9bdd-8617e03ac75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:24.860192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:24.886914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:24.927002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 169/345] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:24.927880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1120a8-c913-44e9-9bdd-8617e03ac75f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:24.950325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bff92-5e55-4927-9891-ee67028515f7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:25.028074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43da0e9-19be-4284-a054-505c2c8ed6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:25.028702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da0e9-19be-4284-a054-505c2c8ed6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.028968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da0e9-19be-4284-a054-505c2c8ed6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.029227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da0e9-19be-4284-a054-505c2c8ed6b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.045262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1120a8-c913-44e9-9bdd-8617e03ac75f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:25.083189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:25.083758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.084321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.084594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.085984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:25.087634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:25.089327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 170/346] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:24 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:25.095200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:25.137823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:25.173522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43da0e9-19be-4284-a054-505c2c8ed6b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:25.175005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43da0e9-19be-4284-a054-505c2c8ed6b7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:25.253577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:25.286494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2da5c-7182-48a2-b404-c1fc4a17e892 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:25.341728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 177/347] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:25.343027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bee2-810a-4680-be90-09f9d9df6e04 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.343294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bee2-810a-4680-be90-09f9d9df6e04 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.343560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bee2-810a-4680-be90-09f9d9df6e04 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.345111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 178/348] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:25.350192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bee2-810a-4680-be90-09f9d9df6e04 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:25.366226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b981e-fce2-43ae-9405-8481d13d6a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:25.367222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b981e-fce2-43ae-9405-8481d13d6a0f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.367694 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b981e-fce2-43ae-9405-8481d13d6a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.368182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b981e-fce2-43ae-9405-8481d13d6a0f None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.384041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b981e-fce2-43ae-9405-8481d13d6a0f None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:25.385653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b981e-fce2-43ae-9405-8481d13d6a0f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:25.387678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 171/349] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:25 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:25.389687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788fc9-e1e4-47a0-97d5-0af9bf6a957d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.389969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788fc9-e1e4-47a0-97d5-0af9bf6a957d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.390238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788fc9-e1e4-47a0-97d5-0af9bf6a957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.414812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-24788fc9-e1e4-47a0-97d5-0af9bf6a957d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:25.417025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-24788fc9-e1e4-47a0-97d5-0af9bf6a957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:25.471176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bee2-810a-4680-be90-09f9d9df6e04 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:25.505801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 172/350] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:25.506754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24788fc9-e1e4-47a0-97d5-0af9bf6a957d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:25.510987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:25.512519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.512815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.513091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.514266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:25.522878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:25.522878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 179/351] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:25 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:25.522878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:25.538773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:25.557653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:25.654314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828d3c-9715-4423-a105-51713d482038 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:25.678852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24788fc9-e1e4-47a0-97d5-0af9bf6a957d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:25.699909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892ff9-a0d0-459c-9eb7-d4782eae44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:25.700537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892ff9-a0d0-459c-9eb7-d4782eae44de None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.700812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892ff9-a0d0-459c-9eb7-d4782eae44de None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.701080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892ff9-a0d0-459c-9eb7-d4782eae44de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.702126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892ff9-a0d0-459c-9eb7-d4782eae44de None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=58b627a5b2654721969213a82bb92f70) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:25.702441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892ff9-a0d0-459c-9eb7-d4782eae44de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:25.703942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892ff9-a0d0-459c-9eb7-d4782eae44de None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:25.710860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 180/352] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:25 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:25.712350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7afa2-a563-4cf4-86b0-92a22fa7924e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.712635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7afa2-a563-4cf4-86b0-92a22fa7924e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.712906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7afa2-a563-4cf4-86b0-92a22fa7924e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.715263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 181/353] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:25.716047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7afa2-a563-4cf4-86b0-92a22fa7924e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:25.726926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d3f18-15d0-4a8c-8de8-47db6ac92b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:25.728679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3f18-15d0-4a8c-8de8-47db6ac92b17 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.729173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3f18-15d0-4a8c-8de8-47db6ac92b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.729664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3f18-15d0-4a8c-8de8-47db6ac92b17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.748769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d3f18-15d0-4a8c-8de8-47db6ac92b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-539d3f18-15d0-4a8c-8de8-47db6ac92b17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:25.754879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:25.757165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 173/354] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:25.759091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29365a4-b68a-49e4-a3a6-dd006065394f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.760779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29365a4-b68a-49e4-a3a6-dd006065394f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.760779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29365a4-b68a-49e4-a3a6-dd006065394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.784147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f29365a4-b68a-49e4-a3a6-dd006065394f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:25.785425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f29365a4-b68a-49e4-a3a6-dd006065394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:25.838119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:25.850569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7afa2-a563-4cf4-86b0-92a22fa7924e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:25.867366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 174/355] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:25.868239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29365a4-b68a-49e4-a3a6-dd006065394f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:25.881489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:25.887346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:25.888294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:25.888755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:25.889252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:25.890548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:25.892221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:25.894310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 182/356] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:25 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:25.899999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.000981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29365a4-b68a-49e4-a3a6-dd006065394f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.020086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ac352-ede7-4fce-846f-e4dde9f9bb6c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.038750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.039459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.039731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.039988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.040667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:26.040967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:26.042464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:26.055336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 175/357] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:26.056193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.065406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.067182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.067743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.068201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.069730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=58b627a5b2654721969213a82bb92f70) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:26.070652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:26.072727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:26.082542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 183/358] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:25 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:26.084518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.119730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:26.148037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:26.187142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d858c3-2223-44a4-a740-62a98f6c11a5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.215059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcfcd4-2786-432c-9dcc-386395a2d842 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.229812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.230419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.230693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.230999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.243651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:26.249205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:26.250141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:26.250957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 176/359] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:26.258373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.263207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.264129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.264596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.265077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.342743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:26.344669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:26.376711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:26.385796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6cd0e-b642-45f0-919a-7226a496e199 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.448622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:26.457122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff1b04-7175-41e6-9dfd-abc043aead94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.457805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1b04-7175-41e6-9dfd-abc043aead94 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.458078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1b04-7175-41e6-9dfd-abc043aead94 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.458341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1b04-7175-41e6-9dfd-abc043aead94 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.459047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff1b04-7175-41e6-9dfd-abc043aead94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:26.459348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff1b04-7175-41e6-9dfd-abc043aead94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:26.460755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff1b04-7175-41e6-9dfd-abc043aead94 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:26.471722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 177/360] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:26.473223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965296-c16f-4c7d-a527-0d77ac74f193 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.473509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965296-c16f-4c7d-a527-0d77ac74f193 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.473790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965296-c16f-4c7d-a527-0d77ac74f193 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.475428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 178/361] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:26.478027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965296-c16f-4c7d-a527-0d77ac74f193 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.486168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 184/362] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:26.487320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.607908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965296-c16f-4c7d-a527-0d77ac74f193 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.613094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494649e-0446-48b2-b1b0-7dbdbb176fdc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.646613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:26.661196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.661906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.662188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.662457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.663260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7579890-2e33-48fd-86c8-35567602dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.663904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579890-2e33-48fd-86c8-35567602dc96 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.664176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579890-2e33-48fd-86c8-35567602dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.664541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579890-2e33-48fd-86c8-35567602dc96 None admin] PATH_INFO: `/v3/users/bf61a7932b694fb7a962fd9b1fc739f9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.665772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7579890-2e33-48fd-86c8-35567602dc96 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61a7932b694fb7a962fd9b1fc739f9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:26.667293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7579890-2e33-48fd-86c8-35567602dc96 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:26.668893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 185/363] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/users/bf61a7932b694fb7a962fd9b1fc739f9 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:26.670122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beba4d-11c0-4460-9e18-4d35e7124c55 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.670396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beba4d-11c0-4460-9e18-4d35e7124c55 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.670659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beba4d-11c0-4460-9e18-4d35e7124c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.681784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:26.687552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:26.688452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:26.689251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 179/364] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:26.689915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.694508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-65beba4d-11c0-4460-9e18-4d35e7124c55 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:26.694508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-65beba4d-11c0-4460-9e18-4d35e7124c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:26.754588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:26.771143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 186/365] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:26.772019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65beba4d-11c0-4460-9e18-4d35e7124c55 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.837677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6df6e-3f6f-46a2-a957-10ff4c6188c6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.900166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.900816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.901096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.901367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.902553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:26.904210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:26.905880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 180/366] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:26.906222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65beba4d-11c0-4460-9e18-4d35e7124c55 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:26.906647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:26.930078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:26.945292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:26.946278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:26.946757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:26.947240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:26.948154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] RBAC: Adding query filter params (role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9, user.id=bf61a7932b694fb7a962fd9b1fc739f9, scope.system=all) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:26.948756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:26.950413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:26.963522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 187/367] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/role_assignments?user.id=bf61a7932b694fb7a962fd9b1fc739f9&scope.system=all&role.id=c6074ceff02c4ce8b1e81d0ccdc65dd9 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:26.964933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:27.077849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed7cd2-727d-4342-813f-5c23795916c6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:27.121080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:27.123208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce95c-d147-414c-ac08-9d44228380bb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:27.124117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:27.124584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:27.125039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:27.128332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:27.130196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:27.133097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 188/368] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:27.139591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:27.168652 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:27.200464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:27.201104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:27.201379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:27.201646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:27.202402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:27.202698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:27.204175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:27.216147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:27.219379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 181/369] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:27.220243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:27.269843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec19a5-d250-4978-bde0-17f377d4d897 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:27.309575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:27.310639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:27.311153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:27.311611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:27.312528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=1b001a834b944749a246332386bc50a2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:27.313561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:27.315276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:27.322219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 189/370] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:27 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:27.323592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:27.424070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d913a8-2c3b-4bd5-8c1a-18348fd097dd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:27.498184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:27.498859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:27.499148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:27.499430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:27.514222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62990-8c2a-4d81-b2f1-a26963ece060 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:27.523527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:27.529130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:27.530070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:27.530904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:27.537505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 182/371] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:16:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:27.540372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:27.541375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:27.579573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:27.580222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:27.580540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:27.580815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:27.601640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:27.715025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc8af-8f3a-49b6-837a-56fbbf87d69c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:27.725280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:27.726772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:27.773835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:27.776352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:27.777044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:27.778490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:27.779413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:27.780098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:27.782401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:27.795914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 183/372] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:27.803958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:27.934545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabaa29-b994-441a-a303-02cc7f7411e0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:27.943173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:27.959718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 190/373] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:27.972028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:27.988210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:27.990571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:27.991390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:27.991726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:27.991963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:28.113133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:28.115410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:28.119570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c8052-af6a-409e-8970-8ca5dd6039eb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:28.184707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:28.185355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:28.185630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:28.185897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:28.187083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:28.189973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:28.191659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 191/374] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:27 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:28.197501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:28.308552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 184/375] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:28.313895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:28.318012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:28.318607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:28.356294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188382-7128-4286-bb4d-e0af2fd78249 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:28.419725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:28.420373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:28.420645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:28.420919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:28.424263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:28.425727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:28.427404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 192/376] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:28 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:28.433743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:28.490037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23673ab7-45bd-4677-97a2-0c2624bb990f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:28.562549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:28.563144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:28.563418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:28.563687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] PATH_INFO: `/v3/projects/7faaeb98831242a0b51ad3154e077405` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:28.564883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] RBAC: Authorizing `identity:get_project(project_id=7faaeb98831242a0b51ad3154e077405)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:28.566456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:28.568525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 185/377] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:28 2022] GET /identity/v3/projects/7faaeb98831242a0b51ad3154e077405 => generated 344 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:28.573629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:28.620104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f73aec-17a2-48f7-a729-b5be2c119358 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:28.690472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:28.691119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:28.691398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:28.691666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:28.692434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=1b001a834b944749a246332386bc50a2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:28.692739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:28.694668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:28.702337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:28.707036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 193/378] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:28 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 260 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:28.738848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845ef9e-296a-4fc6-bad3-c44f6cd899dc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:28.785384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790438ce-264a-4246-8e0a-5766cd3a1bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:28.786106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790438ce-264a-4246-8e0a-5766cd3a1bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:28.786382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790438ce-264a-4246-8e0a-5766cd3a1bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:28.786653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790438ce-264a-4246-8e0a-5766cd3a1bd0 None admin] PATH_INFO: `/v3/groups/8d124b78380e4edd9ae39f1ec9e0f114` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:28.795651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790438ce-264a-4246-8e0a-5766cd3a1bd0 None admin] RBAC: Authorizing `identity:get_group(group_id=8d124b78380e4edd9ae39f1ec9e0f114)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:28.797203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790438ce-264a-4246-8e0a-5766cd3a1bd0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:28.799389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 186/379] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:28 2022] GET /identity/v3/groups/8d124b78380e4edd9ae39f1ec9e0f114 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:28.805312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:28.828923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:28.961404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518276-0a76-4eee-b319-fa70b5288d3e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:28.961788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518276-0a76-4eee-b319-fa70b5288d3e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:28.961950 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518276-0a76-4eee-b319-fa70b5288d3e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:28.963629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 187/380] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:28.970878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce352c-d84a-4b16-b486-aa00319cb11d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:28.972688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0036bd-ae47-448a-8091-2f1120be2843 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:28.973269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0036bd-ae47-448a-8091-2f1120be2843 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:28.973760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0036bd-ae47-448a-8091-2f1120be2843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.009650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-db0036bd-ae47-448a-8091-2f1120be2843 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:29.011326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-db0036bd-ae47-448a-8091-2f1120be2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:29.013084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02fee9-b8f7-4b9a-a969-8278fe4938cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:29.013726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02fee9-b8f7-4b9a-a969-8278fe4938cf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:29.013996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02fee9-b8f7-4b9a-a969-8278fe4938cf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:29.014409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02fee9-b8f7-4b9a-a969-8278fe4938cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.015323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02fee9-b8f7-4b9a-a969-8278fe4938cf None admin] RBAC: Adding query filter params (group.id=8d124b78380e4edd9ae39f1ec9e0f114, role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=7faaeb98831242a0b51ad3154e077405) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:29.015789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02fee9-b8f7-4b9a-a969-8278fe4938cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:29.017464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02fee9-b8f7-4b9a-a969-8278fe4938cf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:29.027789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 194/381] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:28 2022] GET /identity/v3/role_assignments?group.id=8d124b78380e4edd9ae39f1ec9e0f114&scope.project.id=7faaeb98831242a0b51ad3154e077405&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:29.029575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04dfc8-9f3e-4b58-90c5-027e2978e769 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:29.030016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04dfc8-9f3e-4b58-90c5-027e2978e769 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:29.030468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04dfc8-9f3e-4b58-90c5-027e2978e769 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.032110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 195/382] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:29.038579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f9c2-a92c-45d8-b60b-7ca11346b727 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:29.039243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f9c2-a92c-45d8-b60b-7ca11346b727 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:29.039662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f9c2-a92c-45d8-b60b-7ca11346b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.065591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-38a6f9c2-a92c-45d8-b60b-7ca11346b727 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:29.067316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-38a6f9c2-a92c-45d8-b60b-7ca11346b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:29.108173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 188/383] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:29.150471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 196/384] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:29.396052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0036bd-ae47-448a-8091-2f1120be2843 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:29.430095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f9c2-a92c-45d8-b60b-7ca11346b727 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:29.433295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:29.489579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:29.534864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f9c2-a92c-45d8-b60b-7ca11346b727 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:29.553320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0036bd-ae47-448a-8091-2f1120be2843 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:29.571719 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:29.572440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:29.572717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:29.572984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.585000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:29.590294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:29.591263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:29.592078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:29.594369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 197/385] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:29.598360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:29.652198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:29.653182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:29.653657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:29.654125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.671250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:29.681298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:29.690851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:29.691952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:29.692752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:29.700366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 189/386] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:29.706059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:29.709281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f919b-da13-49e3-8712-dcde02e6879d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:29.748009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:29.748626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:29.748903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:29.749172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.749849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:29.750344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:29.751975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:29.761056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 198/387] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:29.767048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:29.877294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e86163-303a-424e-a951-e9b380d6c91a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:29.915521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:29.920688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de7a7-51c9-480f-8ef1-eadf3632ae89 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:29.929273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:29.929927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:29.930198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:29.930466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:29.937665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:29.939186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:29.941064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 199/388] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:29 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:29.950552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:29.990218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:30.011308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:30.011936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.012207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.012474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.013153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:30.013451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:30.014893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:30.034289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 190/389] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:30.040214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:30.130425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52989b6-90d0-4e59-acb4-e9e75b7dbbc0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:30.172964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73b14a-cce1-4ee5-928d-09e7f97b37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:30.173532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b14a-cce1-4ee5-928d-09e7f97b37a0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.173807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b14a-cce1-4ee5-928d-09e7f97b37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.174074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b14a-cce1-4ee5-928d-09e7f97b37a0 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.177681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73b14a-cce1-4ee5-928d-09e7f97b37a0 None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:30.179322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73b14a-cce1-4ee5-928d-09e7f97b37a0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:30.181753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 200/390] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:29 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:30.182940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e167d-f918-45a7-99e9-69967df2bac5 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.183220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e167d-f918-45a7-99e9-69967df2bac5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.183491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e167d-f918-45a7-99e9-69967df2bac5 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.185095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 201/391] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:30.187084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e167d-f918-45a7-99e9-69967df2bac5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:30.205389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088031d1-e3bc-4421-b03a-65dfbe947b0a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:30.248618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cfc64-df5a-46cf-82a5-486b1257fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:30.249361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfc64-df5a-46cf-82a5-486b1257fefa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.249640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfc64-df5a-46cf-82a5-486b1257fefa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.249910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfc64-df5a-46cf-82a5-486b1257fefa None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.251070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cfc64-df5a-46cf-82a5-486b1257fefa None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:30.252711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cfc64-df5a-46cf-82a5-486b1257fefa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:30.254632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 191/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:30 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:30.255882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630235a6-7f1a-45de-8184-d33519fc00cf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.256164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630235a6-7f1a-45de-8184-d33519fc00cf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.256432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630235a6-7f1a-45de-8184-d33519fc00cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.264573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:30.282429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-630235a6-7f1a-45de-8184-d33519fc00cf None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:30.283755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-630235a6-7f1a-45de-8184-d33519fc00cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:30.311617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e167d-f918-45a7-99e9-69967df2bac5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:30.342131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:30.356037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:30.356724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.356999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.357675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70/groups/37f9bccaff284acba0751bffadd77100/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.360299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] RBAC: Authorizing `identity:create_grant(project_id=58b627a5b2654721969213a82bb92f70, group_id=37f9bccaff284acba0751bffadd77100, role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:30.361748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:30.362324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 192/393] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:30.363201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630235a6-7f1a-45de-8184-d33519fc00cf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:30.387232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 202/394] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 15 07:16:30 2022] PUT /identity/v3/projects/58b627a5b2654721969213a82bb92f70/groups/37f9bccaff284acba0751bffadd77100/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:30.491284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630235a6-7f1a-45de-8184-d33519fc00cf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:30.530546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:30.531234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.531508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.531771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.532985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:30.534583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:30.536812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 193/395] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:30 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:30.543151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:30.680314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b8b1-27f6-42f6-99f9-fe47ec38c183 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:30.708702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:30.725633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:30.726313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.726591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.726893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70/groups/37f9bccaff284acba0751bffadd77100/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.732191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] RBAC: Authorizing `identity:create_grant(project_id=58b627a5b2654721969213a82bb92f70, group_id=37f9bccaff284acba0751bffadd77100, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:30.733662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:30.739384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:30.762018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 203/396] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 15 07:16:30 2022] PUT /identity/v3/projects/58b627a5b2654721969213a82bb92f70/groups/37f9bccaff284acba0751bffadd77100/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:30.817995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:30.874601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b446c-33c2-48dd-bc6b-9a3f5df8daca None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:30.913447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:30.914110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:30.914383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:30.914654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:30.928783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:30.935151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:30.936105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:30.936907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 194/397] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:30.943482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:31.101118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab1615-27fb-430f-9a3c-23892c6c504c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:31.139805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:31.140438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:31.140718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:31.140991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:31.141676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] RBAC: Adding query filter params (name=member) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:31.141979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:31.143425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:31.154357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 204/398] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:31.163315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:31.277559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb989326-8fa1-4d8f-ac36-36453b6138f8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:31.292677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:31.319198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:31.319853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:31.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:31.320404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:31.321674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:31.323172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:31.325122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 195/399] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:31 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:31.330816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:31.379025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:31.439847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76d1b-20b1-4ce5-beb0-d5abf0b43ccb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:31.481287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd28e3-5c8f-445d-81a4-2626ae60ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:31.481994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd28e3-5c8f-445d-81a4-2626ae60ea58 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:31.482277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd28e3-5c8f-445d-81a4-2626ae60ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:31.482546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd28e3-5c8f-445d-81a4-2626ae60ea58 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:31.483753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd28e3-5c8f-445d-81a4-2626ae60ea58 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:31.485261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd28e3-5c8f-445d-81a4-2626ae60ea58 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:31.490948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 205/400] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:31 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:31.493383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:31.588888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf6dba-8156-4084-89ed-b417bb5d1706 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:31.589791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf6dba-8156-4084-89ed-b417bb5d1706 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:31.590284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf6dba-8156-4084-89ed-b417bb5d1706 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:31.592784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 206/401] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:31.599652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5a28-477d-483c-84b0-bb0e8041861c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:31.600684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5a28-477d-483c-84b0-bb0e8041861c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:31.601183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5a28-477d-483c-84b0-bb0e8041861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:31.614096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e0560-0293-4de0-a740-ad943f0a556c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:31.630915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c62a5a28-477d-483c-84b0-bb0e8041861c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:31.630915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c62a5a28-477d-483c-84b0-bb0e8041861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:31.676911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedafb4-62a6-4749-84e1-bcda5b8f3d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:31.677592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedafb4-62a6-4749-84e1-bcda5b8f3d77 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:31.677867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedafb4-62a6-4749-84e1-bcda5b8f3d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:31.678135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedafb4-62a6-4749-84e1-bcda5b8f3d77 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2/groups/37f9bccaff284acba0751bffadd77100/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:31.682054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedafb4-62a6-4749-84e1-bcda5b8f3d77 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b001a834b944749a246332386bc50a2, group_id=37f9bccaff284acba0751bffadd77100, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:31.683580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedafb4-62a6-4749-84e1-bcda5b8f3d77 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:31.716049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 196/402] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 15 07:16:31 2022] PUT /identity/v3/projects/1b001a834b944749a246332386bc50a2/groups/37f9bccaff284acba0751bffadd77100/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:31.741362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 207/403] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:32.087035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f98a-37ab-4a26-b2d5-18ff3fa37c0d None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:32.087700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f98a-37ab-4a26-b2d5-18ff3fa37c0d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:32.087700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f98a-37ab-4a26-b2d5-18ff3fa37c0d None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:32.089119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 197/404] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:32.094231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb891a-aac9-486b-9ebe-c657e84fd608 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:32.095085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb891a-aac9-486b-9ebe-c657e84fd608 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:32.095578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb891a-aac9-486b-9ebe-c657e84fd608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:32.123865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d1eb891a-aac9-486b-9ebe-c657e84fd608 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:32.125452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d1eb891a-aac9-486b-9ebe-c657e84fd608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:32.139475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902f98a-37ab-4a26-b2d5-18ff3fa37c0d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:32.169054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:32.191843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:32.221489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 208/405] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:32.256157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902f98a-37ab-4a26-b2d5-18ff3fa37c0d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:32.293504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:32.294547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:32.295086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:32.295572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:32.309464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:32.315155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:32.316127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:32.317083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:32.319920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 198/406] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:32.326261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb891a-aac9-486b-9ebe-c657e84fd608 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:32.431676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb891a-aac9-486b-9ebe-c657e84fd608 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:32.478353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:32.479002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:32.479282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:32.479550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:32.480220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:32.480518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:32.481893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:32.490150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 209/407] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:32.496096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:32.619318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c2044-78eb-488e-abe5-a01c6e783620 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:32.621238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:32.628396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:32.663722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:32.664371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:32.664645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:32.664917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:32.666141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:32.667634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:32.669696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 199/408] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:32 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:32.675267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:32.693422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:32.778285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915a24f-5112-4a38-97bf-78e6fe6d9090 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:32.782356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d456d7-b3be-4b3f-a7d2-ae1b706d6a22 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:32.818730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:32.820306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:32.820947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:32.821221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:32.821493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:32.821959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:32.822236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:32.822510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:32.823772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:32.826699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:32.836034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 200/409] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:32 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:32.837759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:32.852344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:32.857881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:32.858753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:32.859608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 210/410] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:32.868838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:32.912738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:33.018549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d662-95cd-4ec5-b436-33ff9e67004d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:33.050562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:33.063550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490c15-433a-45a7-a97f-ad7857be5afe None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:33.083349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:33.085652 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:33.086663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:33.087139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2/groups/37f9bccaff284acba0751bffadd77100/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:33.091210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b001a834b944749a246332386bc50a2, group_id=37f9bccaff284acba0751bffadd77100, role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:33.094100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:33.115928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 201/411] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 15 07:16:32 2022] PUT /identity/v3/projects/1b001a834b944749a246332386bc50a2/groups/37f9bccaff284acba0751bffadd77100/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:33.126594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec5995-8935-4be7-8487-83240f50063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:33.127935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec5995-8935-4be7-8487-83240f50063d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:33.128431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec5995-8935-4be7-8487-83240f50063d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:33.128922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec5995-8935-4be7-8487-83240f50063d None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:33.129905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec5995-8935-4be7-8487-83240f50063d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:33.130429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec5995-8935-4be7-8487-83240f50063d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:33.132154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec5995-8935-4be7-8487-83240f50063d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:33.142616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 211/412] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:33.152354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:33.310318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:33.314066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c1ca4-a320-4378-8221-b55a8c620346 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:33.352957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75af46-bcb9-4a63-a012-eba4eb07cb42 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:33.353230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75af46-bcb9-4a63-a012-eba4eb07cb42 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:33.353506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75af46-bcb9-4a63-a012-eba4eb07cb42 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:33.357086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 212/413] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:33.359209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:33.359982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:33.360257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:33.360573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] PATH_INFO: `/v3/groups/8d124b78380e4edd9ae39f1ec9e0f114` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:33.361150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66840c-a0ed-4105-848c-c24d5bb2b330 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:33.361432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66840c-a0ed-4105-848c-c24d5bb2b330 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:33.361673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] RBAC: Authorizing `identity:get_group(group_id=8d124b78380e4edd9ae39f1ec9e0f114)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:33.361781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66840c-a0ed-4105-848c-c24d5bb2b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:33.363160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:33.365241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 202/414] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:33 2022] GET /identity/v3/groups/8d124b78380e4edd9ae39f1ec9e0f114 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:33.371756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:33.387409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fb66840c-a0ed-4105-848c-c24d5bb2b330 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:33.388691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fb66840c-a0ed-4105-848c-c24d5bb2b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:33.470403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 213/415] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:33.491882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c0283-8baf-40a2-9b40-1a842b6fac6e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:33.526504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:33.527178 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:33.527448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:33.527711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] PATH_INFO: `/v3/projects/7faaeb98831242a0b51ad3154e077405` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:33.528826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] RBAC: Authorizing `identity:get_project(project_id=7faaeb98831242a0b51ad3154e077405)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:33.530273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:33.532236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 203/416] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:33 2022] GET /identity/v3/projects/7faaeb98831242a0b51ad3154e077405 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:33.537720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66840c-a0ed-4105-848c-c24d5bb2b330 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:33.683507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:33.692672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66840c-a0ed-4105-848c-c24d5bb2b330 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:33.741770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac328919-a686-4681-9605-d388f593430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:33.742447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac328919-a686-4681-9605-d388f593430f None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:33.742720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac328919-a686-4681-9605-d388f593430f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:33.743015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac328919-a686-4681-9605-d388f593430f None admin] PATH_INFO: `/v3/projects/7faaeb98831242a0b51ad3154e077405/groups/8d124b78380e4edd9ae39f1ec9e0f114/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:33.744929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac328919-a686-4681-9605-d388f593430f None admin] RBAC: Authorizing `identity:create_grant(project_id=7faaeb98831242a0b51ad3154e077405, group_id=8d124b78380e4edd9ae39f1ec9e0f114, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:33.746363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac328919-a686-4681-9605-d388f593430f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:33.764342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 214/417] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 15 07:16:33 2022] PUT /identity/v3/projects/7faaeb98831242a0b51ad3154e077405/groups/8d124b78380e4edd9ae39f1ec9e0f114/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:33.835135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:33.882798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:33.978745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e131b-93d1-4cd2-9ccb-dd3f9cb70358 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:34.031405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eebb33-e7db-4b27-bf71-040e1217d998 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.031760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eebb33-e7db-4b27-bf71-040e1217d998 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.032007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eebb33-e7db-4b27-bf71-040e1217d998 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.033174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:34.033836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.034114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.034380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.034477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 215/418] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:34.041373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba144-60c1-495b-90f5-8673b5d4952b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.041690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba144-60c1-495b-90f5-8673b5d4952b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.041920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba144-60c1-495b-90f5-8673b5d4952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.048801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:34.053840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:34.054755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:34.056044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 204/419] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:34.062534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:34.082632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9f9ba144-60c1-495b-90f5-8673b5d4952b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:34.083912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9f9ba144-60c1-495b-90f5-8673b5d4952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:34.183542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:34.187110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7605a3-227f-4f19-bec7-45f195724fc3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:34.194815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 216/420] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:34.224681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:34.225293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.225567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.225835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.226505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:34.226809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:34.228211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:34.236840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 205/421] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:34.242537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba144-60c1-495b-90f5-8673b5d4952b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:34.323071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:34.349898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba144-60c1-495b-90f5-8673b5d4952b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:34.390971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:34.391647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.391924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.392194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.463415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:34.464795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:34.548629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:34.555078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:34.583773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 217/422] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 07:16:34.591672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:34.693357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2532e-6871-4303-9de0-e2205fa249ae None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:34.730595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:34.731219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.731645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.732098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.744992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:34.751226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:34.752103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:34.752884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:34.753582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 206/423] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:34.765768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:34.789484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e875-1066-4407-86cd-a10d9fb27d7a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:34.801875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:34.834285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949d610-200c-4079-9a73-874563390302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:34.834961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d610-200c-4079-9a73-874563390302 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.835253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d610-200c-4079-9a73-874563390302 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.835749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d610-200c-4079-9a73-874563390302 None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.837614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949d610-200c-4079-9a73-874563390302 None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:34.839604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949d610-200c-4079-9a73-874563390302 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:34.841787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 218/424] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:34 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:34.842873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793e87-d8b9-4df4-a36e-e80f8b74d685 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.843283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793e87-d8b9-4df4-a36e-e80f8b74d685 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.843453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793e87-d8b9-4df4-a36e-e80f8b74d685 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.849619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 219/425] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:34.850546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793e87-d8b9-4df4-a36e-e80f8b74d685 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:34.893903 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c69c9-a1f6-42ce-8609-ce2a456fa00c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:34.899441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:34.931052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9806d-3cc3-4798-aa66-0559d6e342d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:34.932360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9806d-3cc3-4798-aa66-0559d6e342d8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.932850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9806d-3cc3-4798-aa66-0559d6e342d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.933355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9806d-3cc3-4798-aa66-0559d6e342d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.934346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9806d-3cc3-4798-aa66-0559d6e342d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:34.934871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9806d-3cc3-4798-aa66-0559d6e342d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:34.936547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9806d-3cc3-4798-aa66-0559d6e342d8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:34.946555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 207/426] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:34.952273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60046e-dbde-4248-a6c1-cd110e7f7f34 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:34.952763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60046e-dbde-4248-a6c1-cd110e7f7f34 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:34.953251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60046e-dbde-4248-a6c1-cd110e7f7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:34.961118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793e87-d8b9-4df4-a36e-e80f8b74d685 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:34.973277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2f60046e-dbde-4248-a6c1-cd110e7f7f34 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:34.975302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2f60046e-dbde-4248-a6c1-cd110e7f7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:34.999315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:34.999968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.000290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.000611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.001750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:35.003425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:35.005380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 220/427] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:34 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:35.006450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:35.048530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 208/428] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:35.049646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60046e-dbde-4248-a6c1-cd110e7f7f34 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:35.060168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:35.162437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd92ee-0376-4083-9b20-ad1e7a1ac606 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:35.178715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:35.201431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:35.202741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.203222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.204090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.212645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60046e-dbde-4248-a6c1-cd110e7f7f34 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:35.279008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:35.281473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:35.296117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:35.296738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.297020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.297284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.298028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=58b627a5b2654721969213a82bb92f70) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:35.298332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:35.299805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:35.314079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 209/429] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:35 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 611 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:35.394423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 221/430] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:35.401067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:35.472473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:35.481385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:35.501484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:35.518625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23abec-323c-4daf-9534-2dc54585bc02 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:35.559345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:35.559935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.560286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.560563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] PATH_INFO: `/v3/projects/58b627a5b2654721969213a82bb92f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.561780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] RBAC: Authorizing `identity:get_project(project_id=58b627a5b2654721969213a82bb92f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:35.563489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:35.565814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 210/431] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:35 2022] GET /identity/v3/projects/58b627a5b2654721969213a82bb92f70 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:35.571755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:35.666326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e2066-663f-476f-bacc-59444d9f4978 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:35.680660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75134d3f-af3c-4df7-9c03-ec29aef77b2e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:35.705280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:35.706337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.706883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.707414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.717331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b7ea4-753b-4b0d-bd29-f095b741fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:35.717971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7ea4-753b-4b0d-bd29-f095b741fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.718246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7ea4-753b-4b0d-bd29-f095b741fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.718515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7ea4-753b-4b0d-bd29-f095b741fdf4 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.719665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:35.719772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b7ea4-753b-4b0d-bd29-f095b741fdf4 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:35.721195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b7ea4-753b-4b0d-bd29-f095b741fdf4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:35.723104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 211/432] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:35 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:35.724564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa8fe3-1988-4089-ac06-083a512e5244 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.724842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa8fe3-1988-4089-ac06-083a512e5244 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.725113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa8fe3-1988-4089-ac06-083a512e5244 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.726303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 212/433] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:35.726655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:35.727659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 07:16:35.728485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:35.730972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 222/434] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:35.731996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:35.732098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a110-37e3-493a-a03d-a03dc3634250 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.732280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a110-37e3-493a-a03d-a03dc3634250 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.732558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a110-37e3-493a-a03d-a03dc3634250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.750775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0c30a110-37e3-493a-a03d-a03dc3634250 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:35.751985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0c30a110-37e3-493a-a03d-a03dc3634250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:35.754022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:35.818748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:35.826116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 213/435] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:35.831961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30a110-37e3-493a-a03d-a03dc3634250 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:35.854203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b3a76-b76e-4588-be8d-b1bfad1f669b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:35.897941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:35.899174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.899683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.900147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.901084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=58b627a5b2654721969213a82bb92f70) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:35.901581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:35.903426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:35.910315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 223/436] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:35 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=58b627a5b2654721969213a82bb92f70&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:35.952531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30a110-37e3-493a-a03d-a03dc3634250 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:35.991387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:35.992411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:35.992879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:35.993337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:35.994222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:35.994714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:35.996335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.003504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.007933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 214/437] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:16:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:36.020075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.089692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.147338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b9d7e-07ee-4b95-87bb-97234ff28733 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.184097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.184718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.185098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.185373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.190080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.214291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bfaa0-2838-46da-b71e-32a5fe018c90 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.256833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.257480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.257761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.258023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.269542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:36.270139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:36.271692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:36.275644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:36.276546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:36.277371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 215/438] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:36.284571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.366205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.400176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 224/439] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:36.405768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.419605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428fbb6-074c-474b-9504-f8158f440821 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.449871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.461513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8229a6a-c801-4761-b755-40e22a593b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.462131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8229a6a-c801-4761-b755-40e22a593b78 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.462548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8229a6a-c801-4761-b755-40e22a593b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.462839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8229a6a-c801-4761-b755-40e22a593b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.463874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8229a6a-c801-4761-b755-40e22a593b78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:36.464188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8229a6a-c801-4761-b755-40e22a593b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:36.465850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8229a6a-c801-4761-b755-40e22a593b78 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.475397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 216/440] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:36.476601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e723547-f97b-4116-8a02-eaaae9689c05 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.476881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e723547-f97b-4116-8a02-eaaae9689c05 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.477153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e723547-f97b-4116-8a02-eaaae9689c05 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.478863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 217/441] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:36.483355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e723547-f97b-4116-8a02-eaaae9689c05 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.529539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca456-e4a5-4ccf-8012-bc31b253891a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.566456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096f83f-72a6-4406-97a5-9743eb68b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.567168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f83f-72a6-4406-97a5-9743eb68b49c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.567444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f83f-72a6-4406-97a5-9743eb68b49c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.567756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f83f-72a6-4406-97a5-9743eb68b49c None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.568905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096f83f-72a6-4406-97a5-9743eb68b49c None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:36.570325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096f83f-72a6-4406-97a5-9743eb68b49c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.572162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 225/442] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:36.573312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a208bf-9e28-4628-99aa-26b8ad30632e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.573586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a208bf-9e28-4628-99aa-26b8ad30632e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.573853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a208bf-9e28-4628-99aa-26b8ad30632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.595019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a4a208bf-9e28-4628-99aa-26b8ad30632e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:36.596215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a4a208bf-9e28-4628-99aa-26b8ad30632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:36.599510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e723547-f97b-4116-8a02-eaaae9689c05 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.625287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.636957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.637649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.637987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.638320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.680018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 226/443] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:36.680018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a208bf-9e28-4628-99aa-26b8ad30632e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.702413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.711549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:36.713040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.769078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a208bf-9e28-4628-99aa-26b8ad30632e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.805030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.805680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.805953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.806204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.807427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:36.808910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.810479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 227/444] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:36.814338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 218/445] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 07:16:36.819981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.820121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.844010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.922343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b429938-0f6b-4e10-87e6-69eca336f920 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.923877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:36.928477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa06832-b121-49a3-b162-416246dda478 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:36.958709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.959344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.959617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.959881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.960602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=b4bb394dff344761ba3dfd2d3be54ad7, scope.project.id=1b001a834b944749a246332386bc50a2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:36.960904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:36.961638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:36.962264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:36.962359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.962537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:36.962803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] PATH_INFO: `/v3/projects/1b001a834b944749a246332386bc50a2` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:36.963942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] RBAC: Authorizing `identity:get_project(project_id=1b001a834b944749a246332386bc50a2)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:36.965374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:36.967296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 219/446] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/projects/1b001a834b944749a246332386bc50a2 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:36.977412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 228/447] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=b4bb394dff344761ba3dfd2d3be54ad7 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:36.977629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:36.977755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:37.076056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:37.089048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0707-8e1f-41b2-b960-7ebc06df2c82 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:37.089588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0a8cb-18fd-43a0-b750-7a14ed9793a2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:37.127985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:37.128727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:37.129063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:37.129391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] PATH_INFO: `/v3/groups/37f9bccaff284acba0751bffadd77100` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:37.130558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] RBAC: Authorizing `identity:get_group(group_id=37f9bccaff284acba0751bffadd77100)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:37.131029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:37.131675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:37.131948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:37.132100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:37.132246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:37.139267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 229/448] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/groups/37f9bccaff284acba0751bffadd77100 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:37.139733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:37.149842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:37.154670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:37.155608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:16:37.156616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:37.161953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 220/449] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:37.162105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:37.184842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:37.263017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c2eed-64eb-47e1-95ec-862ec1833c84 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:37.271993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a4ea5-0754-4444-a6a8-b78b1d85c90f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:37.302104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:37.302783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:37.303148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:37.303450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:37.304209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] RBAC: Adding query filter params (group.id=37f9bccaff284acba0751bffadd77100, role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=1b001a834b944749a246332386bc50a2) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:37.304516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:37.305956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:37.309524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:37.310135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:37.310409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:37.310672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:37.311481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:37.311870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:37.313152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:37.314009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 230/450] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:37 2022] GET /identity/v3/role_assignments?group.id=37f9bccaff284acba0751bffadd77100&scope.project.id=1b001a834b944749a246332386bc50a2&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:37.322461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 221/451] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:37.328184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:37.436194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:37.440372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2d4b-3c72-4a8d-a006-58425940e932 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:37.480454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:37.481076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:37.481361 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:37.481633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:37.550730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:37.552297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:37.652320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:37.658989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 231/452] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:37.662762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:37.678549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:37.767649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cf1cd-6c7d-42bd-9254-c3776ded4c69 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:37.803279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:37.803900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:37.804199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:37.804471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] PATH_INFO: `/v3/projects/7faaeb98831242a0b51ad3154e077405` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:37.805646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] RBAC: Authorizing `identity:get_project(project_id=7faaeb98831242a0b51ad3154e077405)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:37.807117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:37.808734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 222/453] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:16:37 2022] GET /identity/v3/projects/7faaeb98831242a0b51ad3154e077405 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:37.817214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:37.921925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af3eb-103b-4a25-acbe-cd6537f21ccb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:37.956212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6841e5-d0ab-4dd7-8e4e-442b2e8cf2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:37.956828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6841e5-d0ab-4dd7-8e4e-442b2e8cf2dd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:37.957096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6841e5-d0ab-4dd7-8e4e-442b2e8cf2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:37.957399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6841e5-d0ab-4dd7-8e4e-442b2e8cf2dd None admin] PATH_INFO: `/v3/groups/8d124b78380e4edd9ae39f1ec9e0f114` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:37.958529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6841e5-d0ab-4dd7-8e4e-442b2e8cf2dd None admin] RBAC: Authorizing `identity:get_group(group_id=8d124b78380e4edd9ae39f1ec9e0f114)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:37.960000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6841e5-d0ab-4dd7-8e4e-442b2e8cf2dd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:37.961548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 232/454] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 15 07:16:37 2022] GET /identity/v3/groups/8d124b78380e4edd9ae39f1ec9e0f114 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:37.967471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:38.051707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:38.071815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0115751-c688-4e33-afd5-50f0848a01bc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:38.105926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bb934-922a-4a33-95e4-28ac1c79aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:38.106519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bb934-922a-4a33-95e4-28ac1c79aba1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:38.106790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bb934-922a-4a33-95e4-28ac1c79aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:38.107087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bb934-922a-4a33-95e4-28ac1c79aba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:38.107794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bb934-922a-4a33-95e4-28ac1c79aba1 None admin] RBAC: Adding query filter params (group.id=8d124b78380e4edd9ae39f1ec9e0f114, role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=7faaeb98831242a0b51ad3154e077405) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:38.108106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bb934-922a-4a33-95e4-28ac1c79aba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:38.109537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bb934-922a-4a33-95e4-28ac1c79aba1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:38.115483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 223/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 15 07:16:37 2022] GET /identity/v3/role_assignments?group.id=8d124b78380e4edd9ae39f1ec9e0f114&scope.project.id=7faaeb98831242a0b51ad3154e077405&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:40.662015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59900-7719-40c5-b123-4ba6a2743ec2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:40.663030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59900-7719-40c5-b123-4ba6a2743ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:40.663496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59900-7719-40c5-b123-4ba6a2743ec2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:40.665283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 233/456] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:40.670954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ad92-20b8-4e56-83af-58458c66ae3a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:40.671785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ad92-20b8-4e56-83af-58458c66ae3a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:40.672272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ad92-20b8-4e56-83af-58458c66ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:40.699698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1a15ad92-20b8-4e56-83af-58458c66ae3a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:40.701265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1a15ad92-20b8-4e56-83af-58458c66ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:40.780541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 224/457] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:41.079387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151a37-83d6-40e3-9464-079162281a83 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.080037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151a37-83d6-40e3-9464-079162281a83 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.080506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151a37-83d6-40e3-9464-079162281a83 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.082108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 234/458] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:41.087429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b608f17-9211-415e-886e-ad24b7a80459 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.087951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b608f17-9211-415e-886e-ad24b7a80459 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.088414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b608f17-9211-415e-886e-ad24b7a80459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.107302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1b608f17-9211-415e-886e-ad24b7a80459 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:41.108788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1b608f17-9211-415e-886e-ad24b7a80459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:41.152162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151a37-83d6-40e3-9464-079162281a83 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:41.188502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 225/459] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:41.209895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76794c0-c579-4617-8d79-53df63ab2867 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.210188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76794c0-c579-4617-8d79-53df63ab2867 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.210440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76794c0-c579-4617-8d79-53df63ab2867 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.211944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 226/460] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:41.219633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1126751-2167-497c-b82d-41986de2eee3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.224517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1126751-2167-497c-b82d-41986de2eee3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.225000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1126751-2167-497c-b82d-41986de2eee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.236824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:41.251899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c1126751-2167-497c-b82d-41986de2eee3 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:41.253618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c1126751-2167-497c-b82d-41986de2eee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:41.288079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:41.340017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151a37-83d6-40e3-9464-079162281a83 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:41.379218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:41.380179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.380594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.381018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.381296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 227/461] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 15 07:16:41.382612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f9fd7-c15f-44d0-a4e2-b871455a1afe None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.383017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f9fd7-c15f-44d0-a4e2-b871455a1afe None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.383539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f9fd7-c15f-44d0-a4e2-b871455a1afe None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.384895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 228/462] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:41.390080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa43b6-d19a-42e5-81d8-6d7f949c0ced None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.390451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa43b6-d19a-42e5-81d8-6d7f949c0ced None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.390811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa43b6-d19a-42e5-81d8-6d7f949c0ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.393351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:41.395331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:41.416873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:41.418052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:41.419155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:41.419155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:41.419155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:41.419914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4eaa43b6-d19a-42e5-81d8-6d7f949c0ced None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:41.421030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 235/463] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:41.422863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4eaa43b6-d19a-42e5-81d8-6d7f949c0ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:41.428689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:41.527548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 229/464] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:41.535235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa43b6-d19a-42e5-81d8-6d7f949c0ced None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:41.578793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1947373-e6a0-45c7-9d9b-a2782989aef6 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:41.600263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:41.621268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:41.622212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.622683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.623186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.624246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:41.627100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:41.628721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:41.651988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 236/465] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:16:41.660038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:41.675961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:41.755823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa43b6-d19a-42e5-81d8-6d7f949c0ced None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:41.788495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb28ce-3d37-4a81-8242-2072f96cf5e1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:41.792526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:41.793410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.793914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.794397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.805468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:41.807287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:41.826690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:41.827131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:41.827406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:41.827503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:41.828323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:41.829147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:41.829147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:41.829147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:41.829317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:41.829317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:41.829434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 230/466] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:41.829434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:41.829997 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:41.855885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 237/467] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:41 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:41.856631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:41.914278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:41.962459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea88e-6822-469a-8e43-7089b6472b46 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:41.982063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:42.004433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d977a90-00db-42f5-9167-170708408fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.005502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d977a90-00db-42f5-9167-170708408fef None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.006025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d977a90-00db-42f5-9167-170708408fef None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.006490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d977a90-00db-42f5-9167-170708408fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.010666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707d86-31d1-4319-bc49-134a89c7a707 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:42.021842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d977a90-00db-42f5-9167-170708408fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.023374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d977a90-00db-42f5-9167-170708408fef None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1d977a90-00db-42f5-9167-170708408fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:42.045069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:42.046018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:42.046943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:42.046943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:42.046943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:42.046943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 231/468] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:42.047628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d977a90-00db-42f5-9167-170708408fef None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:42.056801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.057536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.057875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.058211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.069852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.071487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:42.089227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:42.090324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:42.091241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:42.091241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:42.091241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:42.091419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 238/469] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:42.092160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:42.180435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d977a90-00db-42f5-9167-170708408fef None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:42.206155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:42.219853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.220783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.221066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.221600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.222254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:42.222557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.223285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58693c-47ac-446e-aa47-83e1e812712d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:42.224413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.247025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 232/470] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:42.247895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:42.266050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.266671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.267009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.267546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.268678 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:42.268988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.271013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.281831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:42.284551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 239/471] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:42.285364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:42.362595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6992e-54c6-4659-b520-4205702cbc6a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:42.398653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2222d4-f98c-4614-b438-13e4b20e2975 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:42.405864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4c080-14e1-4fcd-8065-e67b87ee463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.405864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c080-14e1-4fcd-8065-e67b87ee463b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.405864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c080-14e1-4fcd-8065-e67b87ee463b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.405864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c080-14e1-4fcd-8065-e67b87ee463b None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.406229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4c080-14e1-4fcd-8065-e67b87ee463b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:42.406229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4c080-14e1-4fcd-8065-e67b87ee463b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.406703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4c080-14e1-4fcd-8065-e67b87ee463b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.418520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 233/472] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:42.423413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b5aa-f092-4ce0-a023-cdce0f74adbf None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.423413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b5aa-f092-4ce0-a023-cdce0f74adbf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.423413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b5aa-f092-4ce0-a023-cdce0f74adbf None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.423413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 234/473] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:42.423413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112b5aa-f092-4ce0-a023-cdce0f74adbf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:42.444281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.444919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.445197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.445453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.446110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.447582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.471209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 240/474] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:42 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:42.472018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:42.482122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:42.540089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:42.561530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112b5aa-f092-4ce0-a023-cdce0f74adbf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:42.611154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23670642-d326-4493-a72c-b7b8add15560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.611554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670642-d326-4493-a72c-b7b8add15560 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.611868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670642-d326-4493-a72c-b7b8add15560 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.612141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670642-d326-4493-a72c-b7b8add15560 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.612806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23670642-d326-4493-a72c-b7b8add15560 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.614379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23670642-d326-4493-a72c-b7b8add15560 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.615345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36391ff6-6448-4d05-a013-e09c543c5fe8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:42.650994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 235/475] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:42 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:42.652862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69fda-3474-4d48-bf7e-3e739e640d9a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.653346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69fda-3474-4d48-bf7e-3e739e640d9a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.653812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69fda-3474-4d48-bf7e-3e739e640d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.674578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:42.679762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:42.680053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:42.680512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:42.681322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:42.682947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:42.687564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f7f69fda-3474-4d48-bf7e-3e739e640d9a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:42.689447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f7f69fda-3474-4d48-bf7e-3e739e640d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:42.712742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 241/476] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:42 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:42.780789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 236/477] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:43.055641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:43.137261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:43.195073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09bb55-fee2-4740-8f1a-cea74cb25238 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:43.244667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:43.245304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:43.245577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:43.245844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:43.246515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:43.247935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:43.270899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.sql.core [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 07:16:43.270899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 07:16:43.270899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [parameters: {'id': '847c45585d0044eda5388b55a1c24270', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 07:16:43.270899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81430) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 15 07:16:43.291509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return ref.to_dict() Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 07:16:43.292446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application yield resource Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise self.value Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application session.commit() Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 07:16:43.294006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.flush() Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application compat.raise_( Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 07:16:43.294961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 07:16:43.295850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 07:16:43.296673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [parameters: {'id': '847c45585d0044eda5388b55a1c24270', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:43.298489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 07:16:43.300494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:43.302519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 242/478] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 15 07:16:43 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:43.302654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69fda-3474-4d48-bf7e-3e739e640d9a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:43.396922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:43.435498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69fda-3474-4d48-bf7e-3e739e640d9a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:43.483068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021bcf3-1f59-44fc-a39d-a8880b37c35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:43.483708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021bcf3-1f59-44fc-a39d-a8880b37c35c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:43.483984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021bcf3-1f59-44fc-a39d-a8880b37c35c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:43.484253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021bcf3-1f59-44fc-a39d-a8880b37c35c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:43.498542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021bcf3-1f59-44fc-a39d-a8880b37c35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-d021bcf3-1f59-44fc-a39d-a8880b37c35c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:43.503380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:43.504493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:43.505465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 237/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:16:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:43.512057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:43.670652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94be21-e0f0-448b-a303-e68fecb78418 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:43.699036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:43.714693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769619a-d32e-4539-b4d1-e03cb07b2d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:43.715337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769619a-d32e-4539-b4d1-e03cb07b2d15 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:43.715613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769619a-d32e-4539-b4d1-e03cb07b2d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:43.715880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769619a-d32e-4539-b4d1-e03cb07b2d15 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:43.716544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769619a-d32e-4539-b4d1-e03cb07b2d15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:43.716845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769619a-d32e-4539-b4d1-e03cb07b2d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:43.724243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769619a-d32e-4539-b4d1-e03cb07b2d15 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:43.733012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 243/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:44.348156 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4bd0-e7bc-483a-9b7f-ffcbf94559d5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:44.349058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4bd0-e7bc-483a-9b7f-ffcbf94559d5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:44.349058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4bd0-e7bc-483a-9b7f-ffcbf94559d5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:44.350660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 238/481] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:44.356271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d9e37-c964-46f7-aad7-82209dabba4c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:44.356666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d9e37-c964-46f7-aad7-82209dabba4c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:44.356822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d9e37-c964-46f7-aad7-82209dabba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:44.375651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a29d9e37-c964-46f7-aad7-82209dabba4c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:44.376845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a29d9e37-c964-46f7-aad7-82209dabba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:44.470555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 244/482] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:16:44.924459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4bd0-e7bc-483a-9b7f-ffcbf94559d5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:45.059412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4bd0-e7bc-483a-9b7f-ffcbf94559d5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:45.101902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13663e26-5d94-4467-8804-4e6e92452f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:45.102536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663e26-5d94-4467-8804-4e6e92452f83 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.102805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663e26-5d94-4467-8804-4e6e92452f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.103104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663e26-5d94-4467-8804-4e6e92452f83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.105078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:45.117762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13663e26-5d94-4467-8804-4e6e92452f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-13663e26-5d94-4467-8804-4e6e92452f83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:45.122474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:45.123384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:45.124175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 239/483] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:45.129716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d9e37-c964-46f7-aad7-82209dabba4c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:45.340579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d9e37-c964-46f7-aad7-82209dabba4c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:45.358646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:45.384635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:45.385251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.385531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.385790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.386453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:45.386751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:45.388151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:45.395441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af8ad-bde8-4912-a72a-3f4799724170 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.395894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af8ad-bde8-4912-a72a-3f4799724170 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.395988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af8ad-bde8-4912-a72a-3f4799724170 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.397298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 240/484] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:45.404824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 245/485] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:45.409605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaaa81-4242-44e3-bfb9-d443ff1dba21 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.409891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaaa81-4242-44e3-bfb9-d443ff1dba21 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.410208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaaa81-4242-44e3-bfb9-d443ff1dba21 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.410308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:45.412007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 241/486] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:45.417018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0904-9a6b-479e-9f96-c7afcf613232 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.417299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0904-9a6b-479e-9f96-c7afcf613232 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.417570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0904-9a6b-479e-9f96-c7afcf613232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.438011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9b1d0904-9a6b-479e-9f96-c7afcf613232 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:45.439638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9b1d0904-9a6b-479e-9f96-c7afcf613232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:45.505964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 242/487] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:45.507281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c016d-c9e3-4313-9f87-1947c237aabc None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.507558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c016d-c9e3-4313-9f87-1947c237aabc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.507821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c016d-c9e3-4313-9f87-1947c237aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.520914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec93a43-c94b-48ec-a4f7-4fd1dc81b55a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:45.527538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-da8c016d-c9e3-4313-9f87-1947c237aabc None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:45.528712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-da8c016d-c9e3-4313-9f87-1947c237aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:45.567209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66c17-0637-437a-b27f-dbc3f20d72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:45.568185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66c17-0637-437a-b27f-dbc3f20d72f5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.568740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66c17-0637-437a-b27f-dbc3f20d72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.569290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66c17-0637-437a-b27f-dbc3f20d72f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.582428 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66c17-0637-437a-b27f-dbc3f20d72f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:45.584245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66c17-0637-437a-b27f-dbc3f20d72f5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ffa66c17-0637-437a-b27f-dbc3f20d72f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:45.601098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:45.601983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:45.602946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:45.602946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:45.602946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:45.608699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 246/488] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:45.608699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdeb88-40d4-47bb-8d1d-8085d2c6a0e3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.608699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdeb88-40d4-47bb-8d1d-8085d2c6a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.608699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdeb88-40d4-47bb-8d1d-8085d2c6a0e3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.620927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 247/489] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:45 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:45.627216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 243/490] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:45.628252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdeb88-40d4-47bb-8d1d-8085d2c6a0e3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:45.628459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3556-826f-4f23-9873-c4979678256a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.628799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3556-826f-4f23-9873-c4979678256a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.629070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3556-826f-4f23-9873-c4979678256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.650945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7d8f3556-826f-4f23-9873-c4979678256a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:45.652551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7d8f3556-826f-4f23-9873-c4979678256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:45.703868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:45.711232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:45.726149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 244/491] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:45.783931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f3556-826f-4f23-9873-c4979678256a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:45.868857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdeb88-40d4-47bb-8d1d-8085d2c6a0e3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:45.921373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:45.921985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.922289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.922582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:45.923412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:45.923712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:45.925362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:45.942853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 248/492] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:45.942853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:45.947899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f3556-826f-4f23-9873-c4979678256a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:45.994518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:45.995625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:45.996428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:45.997155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.010414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:46.017002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:46.017922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:46.018717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:46.021773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 245/493] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:46.022812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.048524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.061870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3679c-e21d-4d88-ae93-ccdf1d8d155c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.074994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.097491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.098116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.098383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.099043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.111821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:46.117367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:46.118228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:46.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:46.123127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 249/494] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:46.124371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.131321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb58a13-f91e-422e-8a66-b79afd119762 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.166934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.167567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.167839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.168103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.175133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.176658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:46.190248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:46.191238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 246/495] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:46.192153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.230390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165467-73cb-4f97-a84f-e32a808c934f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.265232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.265846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.266120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.266388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.267077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:46.267376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.268743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.281376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 250/496] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:46.281376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.291666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.302578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c819b-2d71-4820-9f40-3e5cbd6a4c3c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.305197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.337203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.338062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.338343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.338612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.348964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:46.354120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:46.355299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 247/497] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:46.356123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.384335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d2d4-3f84-4278-9df3-aa3b5b16515e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.418583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.419314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.419588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.419853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.420508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:46.420805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.422396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.435249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 251/498] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:46.435249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.461258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a95a8e-8579-40ee-897a-8dab231750f2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.495183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.495793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.496067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.496333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.497053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:46.497352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.498791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.510362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.543492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 248/499] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:46.543492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.551442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03e662-2781-4bfb-b3f2-7c79844dfbf0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.564684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.589688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.590319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.590677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.590870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.602279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.603732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:46.618349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:46.619363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:46.620717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:46.620717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:46.620717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:46.623790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 252/500] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:46.624963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.647213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b061-41b3-42af-adb6-95b8552fe4c0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.684626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.685246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.685517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.685783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.686444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:46.686737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.688165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.696263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 249/501] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:46.696927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.741901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9314-875f-49bc-b678-faa025b34860 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.764107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.775832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.776457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.776730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.777000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.780054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.788487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.789934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.795970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6d49-daad-403d-8ed6-0af19a0e13a9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:46.803539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:46.804588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:46.805451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:46.805451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:46.805451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:46.805451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 253/502] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:46.805451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.830650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.831306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.831576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.831882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.897538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.898946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.902936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e1c60-163d-46ac-a989-7afac37dd66f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:46.935402 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4161f-89c0-4ac7-b5d0-90a87886ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:46.935998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4161f-89c0-4ac7-b5d0-90a87886ca6b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.936273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4161f-89c0-4ac7-b5d0-90a87886ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.936525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4161f-89c0-4ac7-b5d0-90a87886ca6b None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.937164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4161f-89c0-4ac7-b5d0-90a87886ca6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:46.937466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4161f-89c0-4ac7-b5d0-90a87886ca6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:46.938850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4161f-89c0-4ac7-b5d0-90a87886ca6b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:46.950229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 254/503] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:46.951197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861e0b-a677-447c-95ca-74d261c569ef None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:46.951477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861e0b-a677-447c-95ca-74d261c569ef None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:46.951748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861e0b-a677-447c-95ca-74d261c569ef None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:46.952935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 255/504] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:46.953613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83861e0b-a677-447c-95ca-74d261c569ef None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:46.983597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:46.993352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.000244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 250/505] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:47.001050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.056678 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83861e0b-a677-447c-95ca-74d261c569ef None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.089866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.090492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.090766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.091079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.099168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2f26-5b44-4607-80a5-e847e11a2810 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.101071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.102523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:47.116828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:47.117898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:47.119144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:47.119144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:47.119144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:47.119144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 256/506] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:47.119144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.137277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711ca48-582b-47da-81d0-6aebba50e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.137890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ca48-582b-47da-81d0-6aebba50e66e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.138166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ca48-582b-47da-81d0-6aebba50e66e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.138445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ca48-582b-47da-81d0-6aebba50e66e None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.139111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711ca48-582b-47da-81d0-6aebba50e66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:47.139408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711ca48-582b-47da-81d0-6aebba50e66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.140810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711ca48-582b-47da-81d0-6aebba50e66e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.152102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 251/507] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:47.153220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9822f-2cc0-4fc0-825b-35aa2af3332a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.153503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9822f-2cc0-4fc0-825b-35aa2af3332a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.153767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9822f-2cc0-4fc0-825b-35aa2af3332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.171365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-92a9822f-2cc0-4fc0-825b-35aa2af3332a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:47.172551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-92a9822f-2cc0-4fc0-825b-35aa2af3332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:47.209367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.211440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.221561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295616-2737-400e-bc19-e0f64c06c061 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.237672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 252/508] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:47.238471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9822f-2cc0-4fc0-825b-35aa2af3332a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.268110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.269044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.269382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.269706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.277812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.279365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:47.291810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:47.292892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 257/509] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:47.298695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.347043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9822f-2cc0-4fc0-825b-35aa2af3332a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.381469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.382102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.382380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.382653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.393310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.394937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.407155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61272e58-e910-48c1-856f-2a6315bc4ffb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:47.410565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:47.411668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:47.412696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:47.412696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:47.412696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:47.413924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 253/510] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:47.414618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.443269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.446600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.447448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.447738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.448104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.448845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:47.449240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.450712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.463325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 258/511] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:47.467903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.479084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.522271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693fd9b-d8b7-4508-9296-6b7857c95aea None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.555484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.556109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.556379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.556644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.563811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.565267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.569982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21209f-f9a1-4066-8475-7f1fc168f8d3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:47.576403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:47.577489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 254/512] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:47.578743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.606907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.607538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.607779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.608048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.608781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:47.609083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.610526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.648406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 259/513] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:47.649233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.664186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.680003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5ca43-6f37-4234-b0e3-7a02db85a772 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.712758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.713365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.713630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.713770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.713925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.714600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:47.714911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.716343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.728249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 255/514] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:47.729060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.749222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c846f-cdf1-4554-bdce-f02ac23e8988 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.782120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.782998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.783580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.783851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.790674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.792203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:47.805940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:47.806979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 260/515] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:47.807992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.829962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37a15-575b-4501-a259-a3459d1fdd9f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.863088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.863714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.863988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.864253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.874260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.875763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.882389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:47.890891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:47.891899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:47.892741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:47.892741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:47.892741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:47.897105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 256/516] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:47.897980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.903822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052866-40f8-4a1b-8458-f7fd48e96f9b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:47.928788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:47.938422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:47.939086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:47.939358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:47.939627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:47.940347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:47.940641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:47.942087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:47.959733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 261/517] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:47.960525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:47.995511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb19bd9-5a77-4b3d-a517-f28d1ca68c0b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.029393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.030009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.030320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.030555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.067864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9868eaf-4e8e-4cfb-afe9-d51e00eded59 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.099775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.103456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.105221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.105673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.106304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.106579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.106871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.113524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.115025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:48.126570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:48.127568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 262/518] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:48.128677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.174503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.203315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 257/519] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:48.204082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.232102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a3e6-0c70-4788-80b7-63f134504b20 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.264572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.265173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.265442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.265705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.266463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:48.266760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.268286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.284946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 263/520] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:48.285738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.295582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.299552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ca6b4-cf50-4588-8d97-d0bebae67e0d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.334951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.335566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.335840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.336106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.336759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:48.337055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.338430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.350031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 258/521] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:48.351039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.385822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bd0bb-81ca-41be-927e-47b8ffd72505 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.387445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.422097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.422711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.423007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.423276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.453390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f5d6-d31f-4942-80c8-24991b06534b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.486649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.487304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.487583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.487844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.488607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:48.488910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.490176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.490363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.491662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.507516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 259/522] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:48.508305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.527880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.589533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 264/523] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:48.590368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.593066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.608623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a3c4-c114-4280-b5d4-8c9a929aba1e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.645618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.646252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.646517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.646796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.656660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.658118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:48.672756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:48.673683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:48.674545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:48.674545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:48.674545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:48.674545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 260/524] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:48.674545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.698180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b252ce-e507-4097-acfa-cb60735b3cf3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.736383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.736927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.737201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.737469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.744381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.776575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7adf8-6300-40e6-b40a-51254d80a288 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.805058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.806534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.808553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:48.809360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:48.809962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:48.810243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:48.810515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:48.811233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:48.812680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:48.835087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 261/525] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:16:48 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:16:48.835874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.923305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 265/526] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:48.924478 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:48.968947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c0b7-0f4f-424e-a27d-3e5c62f57678 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:48.999183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.010856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.011909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.012193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.012465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.014044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=ded85d4044b1442d95e53c859459738c) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:49.014044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.015637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.021613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 262/527] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/role_assignments?user.id=ded85d4044b1442d95e53c859459738c&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:49.022619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.043993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c41fe-9a17-49fc-b862-29a552403212 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.045978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.093154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.094145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.094417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.094689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.107899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.109813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:49.125733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:49.126888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:49.127777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:49.127777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:49.127777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:49.127777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 266/528] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:49.128179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.159559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262d93-1db1-4090-bd66-6a46a84fe011 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.207432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.208069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.208384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.209245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.209912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:49.210488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.212204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.227664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 263/529] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:49.228644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.251399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70266b86-1a11-483a-a27b-6ac3533f2188 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.295229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.302959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.303763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.304181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.304460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.318247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.320786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:49.338034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:49.339309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:49.340164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:49.340164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:49.340164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:49.340164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 267/530] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:49.340164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.352910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.368113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef91702-7327-41fe-b317-5b28084775fb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.412812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.413834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.414207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.414576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.415806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:49.416479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.418681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.434435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 264/531] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:49.435441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.468873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f475e-3ab9-45bc-aab9-87fa16df2191 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.511981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.513420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.513845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.514269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.523483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.526263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:49.539066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:49.540150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:49.540981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:49.541511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 268/532] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:49.542622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.564215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8922f-4aa5-42f6-8552-50012d5b0c4c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.576210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.601131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.601902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.602275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.602643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.603491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:49.603828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.605312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.616982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.622648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 265/533] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:49.624082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.659134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d210e-27f2-4f94-af5f-60d5f966f750 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.696537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.697469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.697890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.698300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.709011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.710708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:49.724264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:49.725206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:49.726054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:49.728549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 269/534] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:49.729613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.734273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1cb9-f436-405a-89a9-88dab34cb1cb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.772445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.773083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.773487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.773828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.774853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:49.775005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.776578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.789346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 266/535] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:49.790417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.821350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.842054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0fd6a-b535-4bb5-a4f0-32ee7b03e11e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.870418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:49.882273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.883408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.883890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.884352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.892519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.894470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.896496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4381b-6d29-48d9-9343-d1ca07e2eb9b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:49.906992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:49.907947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:49.908813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:49.911544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 270/536] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:49.912663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:49.938583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:49.939113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:49.939387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:49.939656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:49.940421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:49.940745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:49.942227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:49.955102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 267/537] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:49.955925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:50.024886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f185c-5bd0-4163-8bbe-ab1508ca0115 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:50.051547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:50.061264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2b604-e8bc-4285-83ed-fcac9c5433a2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:50.063124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:50.063985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:50.064470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:50.064930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:50.065845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=9308f360df864174967889252718bc10) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:50.066638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:50.068294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:50.075328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 271/538] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/role_assignments?user.id=9308f360df864174967889252718bc10&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:50.076403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:50.099782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:50.100474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:50.100760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:50.101032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:50.101740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:50.102044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:50.103732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:50.116368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 268/539] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:50.122452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:50.135321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:50.193100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9e760-a3ec-4168-9d06-b01b910df54d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:50.230269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e0eba-7e88-4cef-80e3-8ea840b87d0c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:50.232198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9727f5-54ab-4025-9cb8-9c1024b066ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:50.233171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9727f5-54ab-4025-9cb8-9c1024b066ac None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:50.233651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9727f5-54ab-4025-9cb8-9c1024b066ac None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:50.234162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9727f5-54ab-4025-9cb8-9c1024b066ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:50.235161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9727f5-54ab-4025-9cb8-9c1024b066ac None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=2cc638eccee04ac6a71972e255947aee) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:50.235677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9727f5-54ab-4025-9cb8-9c1024b066ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:50.237351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9727f5-54ab-4025-9cb8-9c1024b066ac None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:50.244425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 272/540] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:50 2022] GET /identity/v3/role_assignments?user.id=2cc638eccee04ac6a71972e255947aee&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:50.269775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff4158-c8be-46c0-809d-4bc144ca01de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:50.270599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4158-c8be-46c0-809d-4bc144ca01de None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:50.271048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4158-c8be-46c0-809d-4bc144ca01de None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:50.271332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4158-c8be-46c0-809d-4bc144ca01de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:50.272113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4158-c8be-46c0-809d-4bc144ca01de None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=e870f9d558024213a6db2c32a8d6de24) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:50.272424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4158-c8be-46c0-809d-4bc144ca01de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:50.273977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4158-c8be-46c0-809d-4bc144ca01de None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:50.281320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 269/541] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:50 2022] GET /identity/v3/role_assignments?user.id=e870f9d558024213a6db2c32a8d6de24&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:51.250627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd64a4-88fd-4cdc-8e5f-b557ba12a6eb None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:51.251694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd64a4-88fd-4cdc-8e5f-b557ba12a6eb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:51.252190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd64a4-88fd-4cdc-8e5f-b557ba12a6eb None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:51.254062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 273/542] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:51.259830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4d39-eccd-4ada-a21c-6db09a794ded None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:51.260237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4d39-eccd-4ada-a21c-6db09a794ded None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:51.260427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4d39-eccd-4ada-a21c-6db09a794ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:51.287808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-402c4d39-eccd-4ada-a21c-6db09a794ded None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:51.289032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-402c4d39-eccd-4ada-a21c-6db09a794ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:51.298975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:51.377214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 270/543] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:51.537430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6ef9-699a-40b3-9fb3-b7313c2fa4f5 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:51.538036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6ef9-699a-40b3-9fb3-b7313c2fa4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:51.538520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6ef9-699a-40b3-9fb3-b7313c2fa4f5 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:51.540376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 274/544] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:51.552123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e5b2a-d943-42b5-9456-e84a1e3abdb5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:51.552411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e5b2a-d943-42b5-9456-e84a1e3abdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:51.552692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e5b2a-d943-42b5-9456-e84a1e3abdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:51.575598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e44e5b2a-d943-42b5-9456-e84a1e3abdb5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:51.576795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e44e5b2a-d943-42b5-9456-e84a1e3abdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:51.671491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 271/545] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:51.791486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6ef9-699a-40b3-9fb3-b7313c2fa4f5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:51.908767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6ef9-699a-40b3-9fb3-b7313c2fa4f5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:51.923166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:51.948800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:51.949790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:51.950258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:51.950766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:51.966647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:51.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:51.972614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:51.973816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:51.977062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 275/546] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:51.987209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e5b2a-d943-42b5-9456-e84a1e3abdb5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.003955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.070158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:52.097293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e5b2a-d943-42b5-9456-e84a1e3abdb5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.133233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.133974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.134344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.134705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.135647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:52.136048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:52.137827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:52.146799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 272/547] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:52.152821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.227944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc8afc-eafd-4680-b260-69636691b5c2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.251960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f0753-b0c1-4a1a-b27e-fda9e3562f6c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.279059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.280302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.280715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.281121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.286989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.287772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.288148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.288510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.292919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:52.298323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:52.299260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:52.300077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:52.300851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:52.302299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:52.302874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 276/548] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:52.309486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.310520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:52.320133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:52.321971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:52.323307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:52.323307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:52.323307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:52.323307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 273/549] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:52.330800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.395191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:52.504646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7785333-1df9-4828-886c-0ca97189aa99 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.544500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.545053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b014-27e7-4064-b236-e531aba0defd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.545190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.545379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.545703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.546361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:52.546849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:52.548332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:52.562612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 274/550] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:52.569477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.635511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:52.651527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.652170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.652448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.652723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.653411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:52.653717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:52.655133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:52.681088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 277/551] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:52.684745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71e3b3-d976-4837-8864-908251cfe168 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.687089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.723129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.724498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.724778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.725046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.733079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:52.734546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:52.747362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:52.748408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:52.750500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 275/552] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:52.754989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.913606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e6e8d-8676-48fa-b7c3-538873484325 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.927185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:52.938752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:52.945684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb3b85-e8cf-4e68-952a-f8baf58aefe4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:52.957110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cee70c-343b-442c-8573-7cce35f5d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.958048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cee70c-343b-442c-8573-7cce35f5d288 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.958624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cee70c-343b-442c-8573-7cce35f5d288 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.959134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cee70c-343b-442c-8573-7cce35f5d288 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.960066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cee70c-343b-442c-8573-7cce35f5d288 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:52.960562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cee70c-343b-442c-8573-7cce35f5d288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:52.962405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cee70c-343b-442c-8573-7cce35f5d288 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:52.982165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 276/553] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:52.983269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ff52e-f0f2-4b74-99cf-d04175e75e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:52.983910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ff52e-f0f2-4b74-99cf-d04175e75e3c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.984186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ff52e-f0f2-4b74-99cf-d04175e75e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.984455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ff52e-f0f2-4b74-99cf-d04175e75e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.984684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf49c7-d8ba-43a1-aa60-a01391152bb2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.985169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf49c7-d8ba-43a1-aa60-a01391152bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.985626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf49c7-d8ba-43a1-aa60-a01391152bb2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.987145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 277/554] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:52.991559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fd4be-d256-4d95-8834-1edeaa6376b5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.991842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fd4be-d256-4d95-8834-1edeaa6376b5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.992141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fd4be-d256-4d95-8834-1edeaa6376b5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.993665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 278/555] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:52.994348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9619-8a50-43b1-aea0-989c3d370c06 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:52.994623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9619-8a50-43b1-aea0-989c3d370c06 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:52.995003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9619-8a50-43b1-aea0-989c3d370c06 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:52.995946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ff52e-f0f2-4b74-99cf-d04175e75e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:52.997498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 279/556] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:52.997498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9619-8a50-43b1-aea0-989c3d370c06 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:52.997698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ff52e-f0f2-4b74-99cf-d04175e75e3c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-407ff52e-f0f2-4b74-99cf-d04175e75e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:53.012632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:53.013665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:53.014532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:53.014532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:53.014532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:53.014532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 278/557] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:53.016288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824902f-2979-4a18-85bb-b8aebbcff81e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.016571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824902f-2979-4a18-85bb-b8aebbcff81e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.016843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824902f-2979-4a18-85bb-b8aebbcff81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.034137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c824902f-2979-4a18-85bb-b8aebbcff81e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:53.035382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c824902f-2979-4a18-85bb-b8aebbcff81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:53.097651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9619-8a50-43b1-aea0-989c3d370c06 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.100240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 279/558] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:53.101430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29506ef8-ecc1-4089-8fe9-b24099c2697f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.101710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29506ef8-ecc1-4089-8fe9-b24099c2697f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.101979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29506ef8-ecc1-4089-8fe9-b24099c2697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.126047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-29506ef8-ecc1-4089-8fe9-b24099c2697f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:53.127781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-29506ef8-ecc1-4089-8fe9-b24099c2697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:53.134982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa16ada-0bc5-475c-8875-a2f5632792b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.135592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16ada-0bc5-475c-8875-a2f5632792b3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.135900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16ada-0bc5-475c-8875-a2f5632792b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.136155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16ada-0bc5-475c-8875-a2f5632792b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.146606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16ada-0bc5-475c-8875-a2f5632792b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:53.148086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16ada-0bc5-475c-8875-a2f5632792b3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-cfa16ada-0bc5-475c-8875-a2f5632792b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:53.162315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:53.163791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:53.164701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:53.164701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:53.164701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:53.164701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 280/559] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:53.165372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8aa2-1cb2-44f4-a6d2-c1f45775fd50 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.165372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8aa2-1cb2-44f4-a6d2-c1f45775fd50 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.165534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8aa2-1cb2-44f4-a6d2-c1f45775fd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.183793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0dcc8aa2-1cb2-44f4-a6d2-c1f45775fd50 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:53.184985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0dcc8aa2-1cb2-44f4-a6d2-c1f45775fd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:53.199534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.203630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 280/560] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:53.204525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29506ef8-ecc1-4089-8fe9-b24099c2697f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.214616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.280747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 281/561] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:53.281926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc8aa2-1cb2-44f4-a6d2-c1f45775fd50 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.351460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29506ef8-ecc1-4089-8fe9-b24099c2697f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.394495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.395141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.395421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.395696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.396327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:53.396680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:53.397376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc8aa2-1cb2-44f4-a6d2-c1f45775fd50 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.398047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:53.410883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 281/562] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:53.411836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.442354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.443553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.444284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.445135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.446276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:53.446782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:53.449508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:53.464818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 282/563] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:53.465873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.479901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.487231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.523238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fd871-5870-465b-86fc-23b3a05b55ab None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.559210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.559843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.560118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.560408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.573038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:53.576133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984f06-ed94-4f4b-95b5-c65cd8a5fc6b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:53.579095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:53.580142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 282/564] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:53.581019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.614726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.618049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.618049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.618049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.623703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:53.625776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:53.637324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:53.638279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 283/565] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:53.639257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.677796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed28b9-a64c-4b45-a1fd-743e91728144 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.702785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.705276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.711271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.711901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.712177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.712445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.718984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:53.720453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:53.731821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:53.732709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 283/566] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:53.733617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.743905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40baf-07b8-4eb3-88ec-b08df3d7c9aa None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.778645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.779320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.779595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.779904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.790011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:53.795177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:53.796120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 284/567] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:53.796988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.833807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17925f1b-c83f-444c-b79b-674cd6cc69db None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.867076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.867703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.867980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.868248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.878094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:53.883272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:53.884187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:53.885021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 284/568] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:53.885730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.895484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ad350-1d16-42ee-ae99-9e103236ff99 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:53.920322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.928060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:53.928666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:53.928938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:53.929204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:53.929853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:53.930146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:53.931559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:53.936014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:53.944619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 285/569] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:53.944619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:53.993300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f45fdb-dab3-48bb-aeec-102cc7140fae None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.028915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.029518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.029796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.030064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.030788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:54.031122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.032560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.039127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e1f10-5c25-4dbe-b132-a1cd16873aef None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.049764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 285/570] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:54.050432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.073258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.073869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.074139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.074404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.075117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:54.075415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.076836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.088298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 286/571] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:54.089055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.138538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.147503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3384-3216-4cb5-b5e3-e0c5f632ff8d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.154582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.180420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.181030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.181303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.181577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.182237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:54.182536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.184016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.187502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47eb1f-2201-40e3-8d2e-1fffef44ace4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.191685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 286/572] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:54.192461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.221260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.221873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.222205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.222473 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.223523 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:54.223826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.225189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.232846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 287/573] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:54.233598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.294304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af91-2895-4bfe-8089-1c2699bce770 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.330149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.330726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf1552-92c9-42e5-bca7-e3eec037fc84 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.330891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.331057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.331323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.341390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.342851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.343455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:54.357405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:54.358735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:54.360010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:54.360010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.360010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:54.360010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 287/574] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:54.360010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.373371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.373989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.374259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.374507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.380816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.442343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.443845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.455817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ca8b4-1b7a-41df-9e32-d67e33089a88 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.488631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.489403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.489679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.489949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/ded85d4044b1442d95e53c859459738c/roles/19bf489599ed454d89d91d959f899a44` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.504015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=ded85d4044b1442d95e53c859459738c, role_id=19bf489599ed454d89d91d959f899a44)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.505449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.518077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 288/575] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:54 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/ded85d4044b1442d95e53c859459738c/roles/19bf489599ed454d89d91d959f899a44 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:54.518940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.542559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 288/576] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:54.543541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.562040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.611920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.651693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8d2c-cf3c-434f-be40-72a5eba4e9d1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.667086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe340-dc45-41d4-aafb-275936c4a301 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.690032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.690801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.691189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.691438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.703958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.705407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.712117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.712822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.713094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.713354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:54.725232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:54.726224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:54.727256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:54.727256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.727256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:54.727256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 289/577] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:54.727256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.734414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.735999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:54.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:54.753456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:54.754510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:54.754510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.754510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:54.754510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 289/578] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:54.754510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.820500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.843898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844ce1-9c31-442e-bd1d-56d3b28f459b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.861223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781c03-df5e-4dd7-a1eb-403a9864ae40 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:54.867411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:54.880296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.880905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.881180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.881447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.882094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:54.882389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.883787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.900344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 290/579] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:54.900344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:54.901617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:54.902273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:54.902554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:54.902846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:54.914127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:54.915630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:54.929834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:54.930798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:54.931718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:54.931718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:54.931718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:54.931718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 290/580] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:54.932732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.008165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427078c-3572-4a84-a63f-7cf6cb17004e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.041323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128881-1a55-4bda-9036-f474d87414af None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.043609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.044306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.044648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.044922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.045574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:55.045875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.047281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.060140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.067341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 291/581] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:55.067341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.086209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.086753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.087058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.087326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.087971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:55.088266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.089675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.102123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 291/582] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:55.102988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.120300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.178496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a385a87-7a84-4617-a431-c5ff93abe466 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.202040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6eb2b-2119-422e-9c11-74b96536a285 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.214141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.214773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.215095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.215358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.224578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.226298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.237092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.237901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.238274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.238642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:55.239357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:55.240436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 07:16:55.246201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:55.246937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:55.246937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.247114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 292/583] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:55.247114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.247321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.262723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 292/584] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:55.262723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.297993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.356056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860e263-e7c5-45c9-8ec2-65ae5138f381 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.358031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.364046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b8b7-6ba0-488c-b763-3cd7620bbf9c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.392742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.393389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.393665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.394010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.398321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.399373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.399805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.400220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.403446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.404986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.412062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.413562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:55.417809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:55.418739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 293/585] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:55.424702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:55.425874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:55.426750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 293/586] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:55.434512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.523362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.530038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ed59-f29c-4091-ad5f-42dcdead8be6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.532637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee7df-20a2-4f3f-90cf-49fb91f204d8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.564170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.564794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.565068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.565334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.566503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.567177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.567420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.567684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.568403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:55.568700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.570127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.572413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.574749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:55.586768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:55.595751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:55.596855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:55.597546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 294/587] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:55.597546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.597702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 294/588] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:55.597702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.622814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.701823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d261c-d564-409f-a5ae-0ebe5364c3c7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.713250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525a49-b6e6-41cf-b132-7d42dfacb53b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.737382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.738024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.738298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.738573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.739332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:55.739634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.741103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.749955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.751747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.752203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.752646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.753613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:55.754116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.756271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.759266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 295/589] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:55.760102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.776456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.783253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 295/590] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:55.784194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.868347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9288144-a833-4f6e-b2cd-ad1c8861a782 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.869201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:55.892413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231de7-7999-4020-a13c-7899f271e18f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:55.903461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.904124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.904366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.904587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.915425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.917155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.927355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:55.927964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:55.928242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:55.928512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:55.929264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:55.929615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:55.931091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:55.932691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:55.933600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:55.934498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:55.934498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:55.934498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:55.938493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 296/591] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:55.939069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:55.949864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 296/592] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:55.951116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.006690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.044267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541e1c7-c05d-4c16-9e93-ce23ea9de8ee None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.066020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50537-7cce-4868-81f2-066206a36e52 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.081977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.082711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.083083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.083419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.094593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.096174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.101493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.102132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.102410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.102676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:56.111648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:56.112876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:56.113781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:56.113781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:56.113781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:56.113964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.114111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 297/593] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:56.114919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.123145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.124954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:56.142188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:56.143296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:56.144288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:56.144288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:56.144288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:56.144288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 297/594] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:56.144288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.228641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7acd86-7407-4cfc-9ae1-639124d050be None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.246311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd82298-bd72-44de-abff-a06c714fcce1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.246495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.264758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.265372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.265651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.265922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.266570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:56.266911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.268310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.284396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 298/595] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:56.284625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.284625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.284803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.284874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.284874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.284874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=263fc62721954c23b0357d9e45447713) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:56.284874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.284874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.299225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 298/596] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/role_assignments?user.id=263fc62721954c23b0357d9e45447713&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:56.299225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.359861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.415552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dfe1f-51c4-4a4c-9d9b-1aa6dfc50826 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.422587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41632-cf6b-4632-b53b-47cb5d8cf91d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.454309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.454974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.455253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.455525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.456186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:56.456540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.458162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.472000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.472569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 299/597] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:56.472752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.473504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.473822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.473938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.474697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:56.475106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.476901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.494922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 299/598] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:56.495892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.565363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.600837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab7fc-56c3-4152-83b1-187dfd3bb514 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.616575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.644087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.644716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.644994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.645262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.650060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6c598-e9cc-481f-a52e-0ce948cb1f97 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.653094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.654564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:56.666846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:56.667755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:56.668643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 300/599] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:56.669260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.690361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.691076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.691351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.691614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.698430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.699931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:56.711923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:56.712860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 300/600] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:56.713733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.783433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd485143-3f40-4280-9885-778d3431b983 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.817261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387bafc-185a-4771-a9a1-3af1cca54374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.817894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bafc-185a-4771-a9a1-3af1cca54374 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.818162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bafc-185a-4771-a9a1-3af1cca54374 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.818289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.818435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bafc-185a-4771-a9a1-3af1cca54374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.822466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc233-7542-44be-8a1c-415e30149891 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.825759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bafc-185a-4771-a9a1-3af1cca54374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.827375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bafc-185a-4771-a9a1-3af1cca54374 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f387bafc-185a-4771-a9a1-3af1cca54374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:56.839860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:56.840976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 301/601] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45486-01a6-4380-b165-e5a0a153f903 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.842536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45486-01a6-4380-b165-e5a0a153f903 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.843304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45486-01a6-4380-b165-e5a0a153f903 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.845039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 302/602] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:16:56.845039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45486-01a6-4380-b165-e5a0a153f903 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.875449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:56.876217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:56.876833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:56.877083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:56.877958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:56.878280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:56.879820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:56.881543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:56.897005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 301/603] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:56.897005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:56.964442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45486-01a6-4380-b165-e5a0a153f903 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.996472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858818f0-dfe3-47d8-8409-7b457462d3e8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:56.999918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f4781-6326-4b83-ab16-1404821bb54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:57.000529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4781-6326-4b83-ab16-1404821bb54a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.000798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4781-6326-4b83-ab16-1404821bb54a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.001059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4781-6326-4b83-ab16-1404821bb54a None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.001744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f4781-6326-4b83-ab16-1404821bb54a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:57.002039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f4781-6326-4b83-ab16-1404821bb54a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:57.003578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f4781-6326-4b83-ab16-1404821bb54a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:57.021520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 303/604] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:57.022839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d43deb-b913-4482-b598-f3a5eb997c8e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.023151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d43deb-b913-4482-b598-f3a5eb997c8e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.023412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d43deb-b913-4482-b598-f3a5eb997c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.031455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:57.032072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.032341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.032614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.033306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:57.033665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:57.035271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:57.042357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f4d43deb-b913-4482-b598-f3a5eb997c8e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:57.043660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f4d43deb-b913-4482-b598-f3a5eb997c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:57.051582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 302/605] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:57.051582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:57.070290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:57.120545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 304/606] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:57.121368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d43deb-b913-4482-b598-f3a5eb997c8e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:57.158617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:57.163497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40860c-12f0-476e-bd0d-259f4b47164b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:57.201081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:57.202415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.203150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.203571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/e870f9d558024213a6db2c32a8d6de24/roles/19bf489599ed454d89d91d959f899a44` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.222898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=e870f9d558024213a6db2c32a8d6de24, role_id=19bf489599ed454d89d91d959f899a44)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:57.225621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:57.246916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 303/607] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:57 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/e870f9d558024213a6db2c32a8d6de24/roles/19bf489599ed454d89d91d959f899a44 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:57.248795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:57.254615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d43deb-b913-4482-b598-f3a5eb997c8e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:57.294985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:57.295851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.296214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.296572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/2cc638eccee04ac6a71972e255947aee/roles/19bf489599ed454d89d91d959f899a44` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.316151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=2cc638eccee04ac6a71972e255947aee, role_id=19bf489599ed454d89d91d959f899a44)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:57.318186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:57.335945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 305/608] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:57 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/2cc638eccee04ac6a71972e255947aee/roles/19bf489599ed454d89d91d959f899a44 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:57.352326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:57.415009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fed14-cb70-4e57-ada9-92d77a558337 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:57.445073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:57.478783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:57.479434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.479714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.479984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/9308f360df864174967889252718bc10/roles/19bf489599ed454d89d91d959f899a44` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.508235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=9308f360df864174967889252718bc10, role_id=19bf489599ed454d89d91d959f899a44)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:57.509756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:57.534006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 304/609] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:16:57 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/9308f360df864174967889252718bc10/roles/19bf489599ed454d89d91d959f899a44 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:16:57.584040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:57.616124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9305c7-cc07-4e34-8a81-aab5e3945c58 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:57.659285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:57.660003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.660281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.660638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.674809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:57.679993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:57.680978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:57.681814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:57.682977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 306/610] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:57.689171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:57.817691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d363d3-f69d-4bb1-a40c-0937b3980263 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:57.836115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:57.856508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:57.857095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:57.857376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:57.857640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:57.858306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:57.858603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:57.860028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:57.868839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 305/611] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:57.874642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:57.999312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d583b-d898-46a4-a30c-8d42c157b4fb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:58.042356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:58.043036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:58.043312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:58.043579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:58.048367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:58.057622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:58.059110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:58.077883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:58.078896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:58.079799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:58.079799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:58.079799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:58.082987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 307/612] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:58.089064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:58.300877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6fa8-6b1b-4220-b1fa-4453a12edcc2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:58.353083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:58.353627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:58.353901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:58.354169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:58.354835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:58.355151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:58.356538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:58.373797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 306/613] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:58.375183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:58.481765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ec899-3b53-4780-ba3d-4a8c97d0565c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:58.522535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414eb4e-ee7a-4189-88d0-453b4b508bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:58.523223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414eb4e-ee7a-4189-88d0-453b4b508bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:58.523499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414eb4e-ee7a-4189-88d0-453b4b508bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:58.523770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414eb4e-ee7a-4189-88d0-453b4b508bc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:58.535303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414eb4e-ee7a-4189-88d0-453b4b508bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:58.536807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414eb4e-ee7a-4189-88d0-453b4b508bc2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9414eb4e-ee7a-4189-88d0-453b4b508bc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:16:58.555664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:58.556759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:58.557753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 308/614] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:16:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:58.562639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:58.647184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:58.708753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d84186-ea8d-465b-a28f-f70065ead687 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:58.709113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d84186-ea8d-465b-a28f-f70065ead687 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:58.709292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d84186-ea8d-465b-a28f-f70065ead687 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:58.710640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 309/615] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:16:58.718861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4307-61a8-4f80-a4ee-5db21a77695c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:58.718861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4307-61a8-4f80-a4ee-5db21a77695c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:58.718861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4307-61a8-4f80-a4ee-5db21a77695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:58.723633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2023f15-42de-4ceb-9c72-d36cd82ad3df None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:58.754040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-684a4307-61a8-4f80-a4ee-5db21a77695c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:16:58.755635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-684a4307-61a8-4f80-a4ee-5db21a77695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:16:58.767945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:58.768907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:58.769423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:58.770767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:58.773200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:58.773767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:58.775475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:58.811615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 307/616] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:16:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:58.820738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:58.837238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:58.875561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 310/617] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:16:58.954075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:58.962758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590ce6f-6698-4403-bd29-9a9a3bf3027f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:59.009095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:59.009773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:59.010057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:59.010329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:59.098485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:59.099988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:59.231682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:59.236366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 308/618] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:16:59.241775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4307-61a8-4f80-a4ee-5db21a77695c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:59.329488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:59.385492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4307-61a8-4f80-a4ee-5db21a77695c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:59.420204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:59.420850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:59.421130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:59.421404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:59.432842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:59.434546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:16:59.449573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:59.450573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:16:59.451601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:16:59.451601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:16:59.451601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:59.451601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 311/619] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:59.457148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:59.509930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:59.519979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d737-8ce4-4497-bd53-be4863f8722f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:59.583933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:59.584592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:59.584873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:59.585269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:59.608126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:16:59.615549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:59.616491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:16:59.617336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:16:59.617999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 309/620] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:16:59.627688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:59.666980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa9171-0951-42c4-9ea2-61b77e4441b5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:59.733175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:59.734876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:59.735944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:59.736602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:59.738477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:59.738976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:59.740131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:59.742467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:59.767321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 312/621] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:59.771614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:59.800538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1a13b-a1a9-486c-98f1-e517bb10c155 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:59.848987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:59.850018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:59.850513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:59.851005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:59.852096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:16:59.853650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:59.855479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:59.872931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 310/622] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:16:59.875389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:16:59.913978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:16:59.928798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90222953-400a-4857-8a61-1c7262db2930 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:16:59.966768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b8a55-66c9-4b72-8607-61951b18be5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:16:59.967783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8a55-66c9-4b72-8607-61951b18be5f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:59.968314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8a55-66c9-4b72-8607-61951b18be5f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:59.968808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b8a55-66c9-4b72-8607-61951b18be5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:16:59.977174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b8a55-66c9-4b72-8607-61951b18be5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:16:59.979273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b8a55-66c9-4b72-8607-61951b18be5f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-142b8a55-66c9-4b72-8607-61951b18be5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:16:59.991834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:16:59.992800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:16:59.993689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:16:59.996103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 313/623] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:16:59.997592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71880-b286-48b7-a51e-b878b1b7e476 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:16:59.998046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71880-b286-48b7-a51e-b878b1b7e476 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:16:59.998575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71880-b286-48b7-a51e-b878b1b7e476 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.000443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 314/624] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:00.002448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d71880-b286-48b7-a51e-b878b1b7e476 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.019225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c9e8b-e9e3-400a-80bf-919cce34d833 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.050202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:00.067661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae105a-7eb4-4004-b8d1-9f2a71de6048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.068697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae105a-7eb4-4004-b8d1-9f2a71de6048 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.069227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae105a-7eb4-4004-b8d1-9f2a71de6048 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.069694 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae105a-7eb4-4004-b8d1-9f2a71de6048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.083762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae105a-7eb4-4004-b8d1-9f2a71de6048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:00.085529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae105a-7eb4-4004-b8d1-9f2a71de6048 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b6ae105a-7eb4-4004-b8d1-9f2a71de6048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:00.101843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:00.102902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:00.103811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:00.103811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:00.103811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:00.106196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 311/625] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:00.107695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064413ee-a627-4934-aa75-eaf0c640d3fb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.108135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064413ee-a627-4934-aa75-eaf0c640d3fb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.108566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064413ee-a627-4934-aa75-eaf0c640d3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.126969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d71880-b286-48b7-a51e-b878b1b7e476 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.130390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-064413ee-a627-4934-aa75-eaf0c640d3fb None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:00.132782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-064413ee-a627-4934-aa75-eaf0c640d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:00.165211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.165827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.166101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.166367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.167164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:00.167464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:00.168890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:00.181729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 315/626] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:00.182433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.194779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:00.214562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 312/627] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:00.214562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc028c-a3db-42a9-a36c-b706df2dd275 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.214562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc028c-a3db-42a9-a36c-b706df2dd275 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.214562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc028c-a3db-42a9-a36c-b706df2dd275 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.214562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 313/628] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:00.218586 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc028c-a3db-42a9-a36c-b706df2dd275 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.304862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571f2fb-5a78-4f45-a30d-644c49ef8e02 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.345313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc028c-a3db-42a9-a36c-b706df2dd275 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.347090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:00.353373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41f92-565b-4f55-bc4a-6d0d3f682212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.354274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41f92-565b-4f55-bc4a-6d0d3f682212 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.355054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41f92-565b-4f55-bc4a-6d0d3f682212 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.355359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41f92-565b-4f55-bc4a-6d0d3f682212 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.356079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41f92-565b-4f55-bc4a-6d0d3f682212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:00.356449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41f92-565b-4f55-bc4a-6d0d3f682212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:00.357820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41f92-565b-4f55-bc4a-6d0d3f682212 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:00.374812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 316/629] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:00.376887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d56e0-6910-4f1c-8be4-17cb69f1aee4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.377653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d56e0-6910-4f1c-8be4-17cb69f1aee4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.378190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d56e0-6910-4f1c-8be4-17cb69f1aee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.387784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be495c9a-9296-4c19-a021-31378226d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.388399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495c9a-9296-4c19-a021-31378226d089 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.388670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495c9a-9296-4c19-a021-31378226d089 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.388939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495c9a-9296-4c19-a021-31378226d089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.389662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495c9a-9296-4c19-a021-31378226d089 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=ded85d4044b1442d95e53c859459738c) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:00.389965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495c9a-9296-4c19-a021-31378226d089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:00.391436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495c9a-9296-4c19-a021-31378226d089 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:00.397373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 314/630] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/role_assignments?user.id=ded85d4044b1442d95e53c859459738c&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:00.397680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4b5d56e0-6910-4f1c-8be4-17cb69f1aee4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:00.398538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc0e5-a0a0-4dcb-8780-12afe8bb7f13 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.398832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc0e5-a0a0-4dcb-8780-12afe8bb7f13 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.398945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4b5d56e0-6910-4f1c-8be4-17cb69f1aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:00.399153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc0e5-a0a0-4dcb-8780-12afe8bb7f13 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.400475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 315/631] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:00.401124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc0e5-a0a0-4dcb-8780-12afe8bb7f13 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.479233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:00.491046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 317/632] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:00.491046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7ccd-c0ce-4390-a51d-1da1e205bd43 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.491046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7ccd-c0ce-4390-a51d-1da1e205bd43 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.491046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7ccd-c0ce-4390-a51d-1da1e205bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.519394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-30af7ccd-c0ce-4390-a51d-1da1e205bd43 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:00.520800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-30af7ccd-c0ce-4390-a51d-1da1e205bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:00.533270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc0e5-a0a0-4dcb-8780-12afe8bb7f13 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.587400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.587971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.588251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.588521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.597015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:00.598911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:00.612668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 318/633] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:00.613529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7ccd-c0ce-4390-a51d-1da1e205bd43 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:00.615577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:00.616538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:00.617489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 316/634] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:00.623564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.653891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:00.732525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c28b-be92-4ae3-bd29-20ef7d2ee07b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.741357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7ccd-c0ce-4390-a51d-1da1e205bd43 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.767608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.768921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.769385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.769841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.770465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:00.771453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:00.771960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:00.773684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:00.779951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.780681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.781024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.781361 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.792740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:00.793766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 317/635] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:00.794804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:00.799362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:00.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:00.801225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 319/636] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:00.801918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.894890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:00.912694 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbee0-11f7-4b33-a0f5-cee02316fa6e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.936910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66677cb-cc11-431d-8d58-c79d66ef8290 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:00.947982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.948627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.948901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.949170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.959770 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:00.964757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:00.965685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:00.966541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 318/637] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:00.968125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:00.979406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:00.980136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:00.980414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:00.980686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:00.991355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:00.992803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:01.008591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:01.009609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:01.010527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:01.010527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.010527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:01.014466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 320/638] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:01.015473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.058604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.078189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bff58-55e6-449b-a6ca-cef2d4330206 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.114001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.114621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.114923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.115195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.115864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:01.116163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.117546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.121657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7036cc-4bb6-4c7d-bf65-59af1d099a10 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.125771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 319/639] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:17:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:01.126395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.135826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.165609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.166168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.166446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.166717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.177984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:01.183890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:01.184795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:01.185653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 321/640] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:01.186336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.236606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947367-7325-46d1-84d8-95a17413a916 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.282348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.282670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.283030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.283295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.283990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:01.284301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.285909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.295034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 320/641] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:01.296702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.299199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.302683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66dc70-c89a-4af8-9e13-db1f5014cba2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.340072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.340692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.340972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.341243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.341889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:01.342189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.343589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.356579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 322/642] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:01.357404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.371009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.407449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903cff2-9e11-42f4-a152-db60f124c932 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.448415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.449028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.449253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.449572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.461682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.463300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.467179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149fbda-08e0-43d4-bbd9-565098c39e43 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:01.479283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:01.480528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:01.481437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:01.481437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.481437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:01.481437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 321/643] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:01.481684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.522091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.522639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.522639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.523096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.523932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:01.524276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.525737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.534298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 323/644] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:01.536304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.572991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.603217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f9d6a-add7-448e-af94-b854452c01d8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.632600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.649977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.650616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.650920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.651193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.667086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.668866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.675558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2638d-08f6-4341-8a1f-26fa96872e5b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:01.683468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:01.684480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:01.685557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:01.685557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.685557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:01.685557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 322/645] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:01.685557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.714088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.714808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.715173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.715514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.722228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.724137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:01.735932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:01.736886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:01.738681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 324/646] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:01.742979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.801910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86889a-9672-4d56-8b32-699c4a53cad3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.838623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.841668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.842387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.842866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.843334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.844485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:01.844969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.846727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.869910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 323/647] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:01.871294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.873566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199703-9822-4d43-9070-cf9dbba5e00e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:01.904818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:01.912012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:01.912872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:01.913290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:01.913716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:01.925689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:01.927481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:01.943336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:01.944489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:01.945614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:01.945614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:01.945614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:01.947147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 325/648] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:01.948066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:01.976962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397a01-7b76-4b0f-bbc5-84603add4a1a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.010705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.011340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.011614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.011881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.012518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:02.012812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.014178 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.029789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 324/649] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:02.029789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.060470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d07de6-5183-4f4c-aa88-102776618578 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.098145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.099126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.099647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.100087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.101044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:02.101554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.103029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.104718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.122481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 326/650] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:02.123337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.123778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.132717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2bfc9-deef-4482-b65c-b01cd8fd0776 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.167003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.167628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.167898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.168160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.176667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.178107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:02.188985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:02.190115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:17:02.191420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:02.194773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 325/651] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:02.195600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.234320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b209e-3c1d-490f-bfc6-f5d839cc16c4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.268552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.269155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.269430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.269845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.270607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:02.271410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.273073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.289668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 327/652] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:02.289668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.307345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489d074-b98b-4c0f-ab09-da44b7051e38 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.344935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.350438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.351135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.351405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.351668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.360087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.361560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:02.373259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:02.374205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 326/653] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:02.375638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.391902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.400955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4240b1-66da-4227-a425-6064f47189af None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.436668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.437662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.438147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.438558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/263fc62721954c23b0357d9e45447713/roles/19bf489599ed454d89d91d959f899a44` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.455548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=263fc62721954c23b0357d9e45447713, role_id=19bf489599ed454d89d91d959f899a44)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.457432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.473125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 328/654] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:17:02 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/263fc62721954c23b0357d9e45447713/roles/19bf489599ed454d89d91d959f899a44 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:17:02.476824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91c42c-a2f5-4733-b22a-901385583e4a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.479907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.517418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.518555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.518973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.519335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.520225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:02.520624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.522303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.547658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 327/655] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:02.548819 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.611298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba273e60-3c38-439c-9944-564e50cfd3f1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.629009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.638155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.669353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.670575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.670952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.671291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.678420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296de676-2767-4fe0-8863-6a9521306d4a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.682375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.683882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:02.699894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:02.700903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 329/656] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:02.701850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.720946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.721636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.721910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.722554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.724983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:02.725214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.726665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.755568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 328/657] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:02.756449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.837916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4a43e-c4e5-4ffb-a1cc-5b8b0edffabc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.863096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e3d1-231d-4598-b1f8-2f4ee35ad30d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:02.876589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4bbc2-606a-4c96-8419-f9a7e6772866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.877199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4bbc2-606a-4c96-8419-f9a7e6772866 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.877476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4bbc2-606a-4c96-8419-f9a7e6772866 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.877743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4bbc2-606a-4c96-8419-f9a7e6772866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.891048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.900658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:02.901278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:02.901810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:02.901934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:02.902711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:02.903085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.904517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:02.910969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:02.922478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 329/658] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:02.923521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:02.955854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4bbc2-606a-4c96-8419-f9a7e6772866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:02.957506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4bbc2-606a-4c96-8419-f9a7e6772866 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.034769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc44afd-041d-48f3-8898-ddcfb1d523f0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.061645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 330/659] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:17:03.062966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bff48-220c-4d4d-8719-faeb5938887c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.063252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bff48-220c-4d4d-8719-faeb5938887c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.063521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bff48-220c-4d4d-8719-faeb5938887c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.064956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 331/660] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:03.065512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bff48-220c-4d4d-8719-faeb5938887c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.078306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b18035-e0f0-435d-844c-89350620557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.079093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b18035-e0f0-435d-844c-89350620557c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.079435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b18035-e0f0-435d-844c-89350620557c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.079771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b18035-e0f0-435d-844c-89350620557c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.134028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.138043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.152137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b18035-e0f0-435d-844c-89350620557c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.153624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b18035-e0f0-435d-844c-89350620557c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.177060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bff48-220c-4d4d-8719-faeb5938887c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.213889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3f489-773a-40ac-8d57-9eca8e4d5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.214507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f489-773a-40ac-8d57-9eca8e4d5ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.214785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f489-773a-40ac-8d57-9eca8e4d5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.215086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f489-773a-40ac-8d57-9eca8e4d5ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.255447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 330/661] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:17:03.256207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b18035-e0f0-435d-844c-89350620557c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.290810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3f489-773a-40ac-8d57-9eca8e4d5ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.292322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3f489-773a-40ac-8d57-9eca8e4d5ca3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.343124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.357096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.361618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b18035-e0f0-435d-844c-89350620557c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.398856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 332/662] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:17:03.400446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9769-8ce9-4746-b274-e97a9b00c885 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.400724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9769-8ce9-4746-b274-e97a9b00c885 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.400996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9769-8ce9-4746-b274-e97a9b00c885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.404458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.405255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.405627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.406017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.419132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.420619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.420726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-71ad9769-8ce9-4746-b274-e97a9b00c885 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:03.422106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-71ad9769-8ce9-4746-b274-e97a9b00c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:03.435751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:03.436708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:03.437716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:03.437716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:03.437716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:03.437716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 331/663] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:03.437716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.499017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 333/664] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:03.499017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad9769-8ce9-4746-b274-e97a9b00c885 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.555562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aea84d-ab1f-4013-a1cb-0cf1286c606b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.594221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.595367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.595790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.596763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.606201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.611824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.614509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.628176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.635280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad9769-8ce9-4746-b274-e97a9b00c885 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:03.635730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:03.636756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:03.637633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:03.637633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:03.637633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:03.640425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 332/665] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:03.641481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.687550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.688107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.688383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.688652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.699468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.701003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:03.716345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:03.717335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:03.718218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:03.718218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:03.718218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:03.722314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 334/666] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:03.723572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.764536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc294-bd36-4d58-9760-bb2ed7367e70 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.798813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.799475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.799795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.800070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.800718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:03.801018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.802728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.819527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 333/667] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:03.819527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.834983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e453-cbb4-4fba-aefe-eca116426206 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.869910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.871656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.872270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.872544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.872858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.873503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:03.873791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.875199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.889624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 335/668] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:03.891007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:03.901306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:03.929595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a789-f8a0-43bd-a32c-46fda960a935 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:03.965468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:03.966000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:03.966275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:03.966542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:03.967246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:03.967545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:03.969073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:03.985992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 334/669] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:03.985992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.000702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceeed5-df79-4cc7-8ca7-e8a4ab18fd94 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.037425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.038067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.038343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.038609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.051968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:04.056758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:04.057723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:04.058589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:04.062779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 336/670] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:04.063659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.096813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58309be-7af5-425f-85c8-6e5e9951a0ac None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.108091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.133008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.133294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.133750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.134035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.134408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.142034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.143589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:04.155123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:04.156050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:04.156984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 335/671] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:04.157470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.176106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a0b84-2c2e-4f95-b7a6-b6464b3648d1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.213487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.214411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.214703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.215056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.223198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.224606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:04.236352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:04.237380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:04.238301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 337/672] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:04.238809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.269892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73182903-8d70-4393-a38b-9e6dd0a8ac9e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.305660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.306304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.306633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.306937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.314531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.316041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:04.328174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:04.329089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:04.329988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 336/673] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:04.330490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.351525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eda5e-0f05-4a7c-8858-dd3fac249f66 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.363235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.378762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.387924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.388535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.388812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.389085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.389752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:04.390055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.391457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.399917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 338/674] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:04.400729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.444299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196498-2a7a-42e8-a5bf-1d2077a487b1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.482594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.483635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.484125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.484462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.485241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:04.485539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.487285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.505078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 337/675] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:04.505078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.510978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e910b0-e148-4171-a7ed-52d9924bc8d9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.548004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.548653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.548932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.549207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.549932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:04.550240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.551790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.567377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 339/676] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:04.568236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.621018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.624021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.636430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec595b8-1e52-47dc-9871-26b10af85a5b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.674886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.675506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.675781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.676048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.676741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:04.677042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.677152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f7592-001a-49f2-8808-d4955e3397d9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.678487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.689896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 338/677] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:04.690698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.711207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.711846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.712125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.712400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.722420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.724249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:04.738491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:04.739541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:04.740459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:04.740459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:04.740459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:04.740459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 340/678] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:04.740459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.794740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f719b-c0da-4be7-89d6-b66ab3703740 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.828317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190e8ca-df48-4126-a2a9-e37ff62d80a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.828930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190e8ca-df48-4126-a2a9-e37ff62d80a4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.829207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190e8ca-df48-4126-a2a9-e37ff62d80a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.829477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190e8ca-df48-4126-a2a9-e37ff62d80a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.830201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190e8ca-df48-4126-a2a9-e37ff62d80a4 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=2cc638eccee04ac6a71972e255947aee) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:04.830507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190e8ca-df48-4126-a2a9-e37ff62d80a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.832048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190e8ca-df48-4126-a2a9-e37ff62d80a4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.832502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.835941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af405-3fbb-40c8-8cbe-96fc395c1ad4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:04.838421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 339/679] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/role_assignments?user.id=2cc638eccee04ac6a71972e255947aee&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:04.839705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b448-7739-41d9-9302-4b365b0ebc2e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.839982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b448-7739-41d9-9302-4b365b0ebc2e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.840260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b448-7739-41d9-9302-4b365b0ebc2e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.841434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 340/680] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:04.842117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1b448-7739-41d9-9302-4b365b0ebc2e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.871163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:04.878884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:04.880234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:04.880520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:04.880856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:04.881945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=e870f9d558024213a6db2c32a8d6de24) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:04.882254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:04.884615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:04.892061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 341/681] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/role_assignments?user.id=e870f9d558024213a6db2c32a8d6de24&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:04.892924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:04.987470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1b448-7739-41d9-9302-4b365b0ebc2e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:05.025849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99431ca-62fc-45f2-bc52-12d9a1eafc20 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:05.035645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9b169-27c9-4611-8bbc-4b93326482e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:05.036291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b169-27c9-4611-8bbc-4b93326482e8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.036572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b169-27c9-4611-8bbc-4b93326482e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.036841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b169-27c9-4611-8bbc-4b93326482e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.037591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9b169-27c9-4611-8bbc-4b93326482e8 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=9308f360df864174967889252718bc10) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:05.037897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9b169-27c9-4611-8bbc-4b93326482e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:05.039632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9b169-27c9-4611-8bbc-4b93326482e8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:05.046445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 341/682] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/role_assignments?user.id=9308f360df864174967889252718bc10&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:05.047889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e8a8-534d-4387-8ee4-c73aa5964b3c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.048163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e8a8-534d-4387-8ee4-c73aa5964b3c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.048439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e8a8-534d-4387-8ee4-c73aa5964b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.070646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ec28e8a8-534d-4387-8ee4-c73aa5964b3c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:05.071933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ec28e8a8-534d-4387-8ee4-c73aa5964b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:05.075869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:05.077004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.077517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.078018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.078987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:05.079507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:05.082535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:05.099945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 342/683] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:05.105993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:05.140406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:05.159841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 342/684] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:05.238974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732e9a-4f04-4076-83ad-0dca8db99e10 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:05.278005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:05.278560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.278856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.279122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.286575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:05.288075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:05.300440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:05.301505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:05.304240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 343/685] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:17:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:05.311909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e8a8-534d-4387-8ee4-c73aa5964b3c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:05.327418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:05.437341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e8a8-534d-4387-8ee4-c73aa5964b3c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:05.449673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:05.477704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:05.478328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.478607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.478951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.479764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:05.480063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:05.481623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:05.500449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 343/686] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:17:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:05.507436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:05.589225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:05.605957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f7bc0-3b74-4384-ac7c-479d11df7485 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:05.643238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:05.649562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:05.650358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.650630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.650916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.672893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:05.678700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:05.680116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:05.680960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 344/687] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:05.685724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:05.725421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937208-2444-4332-9e0b-d990bfab2af1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:05.795364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:05.796069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.796348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.796620 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.799834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cd709-bfae-48a6-93c2-284a65da4a73 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:05.871214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:05.871844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:05.872113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:05.872380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:05.873046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:05.873341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:05.874717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:05.895618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 345/688] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:17:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:05.901637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:05.919102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:05.948920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:05.950396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:06.034036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fa55-0aef-4630-aa21-3c822d69998b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:06.081454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:06.082359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:06.082630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:06.082924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:06.098168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:06.098460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:06.100443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:06.132120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:06.133126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:06.134088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:06.134088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:06.134088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:06.134981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 346/689] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:06.141651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:06.170157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 344/690] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 07:17:06.176665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:06.247391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:06.332100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db3bba-5cd2-4bc2-9d02-660a13fa093d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:06.336014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd6d6-f740-47f9-b3ea-7759ca2a085c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:06.392121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:06.392660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:06.392932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:06.393198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:06.393964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:06.394260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:06.395656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:06.399115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:06.399758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:06.400029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:06.400291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:06.411853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:06.413317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:06.426199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 347/691] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:06.428365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:06.429369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:06.430283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:06.430283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:06.430283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:06.430283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 345/692] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:06.431882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:06.434848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:06.456099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:06.562328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9289cd-20ea-414d-bb81-62cdb9945349 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:06.627323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7779ce-fb42-4f42-98ad-28604221b588 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:06.632098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:06.632952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:06.633443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:06.633927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:06.634793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:06.635315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:06.636901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:06.658625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 346/693] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:06.663146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:06.669653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:06.699684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:06.701130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:06.701631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:06.702097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:06.713093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:06.715618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:06.736004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:06.737038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:06.738035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:06.742495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 348/694] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:06.748322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:06.813971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:06.854636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38cb7-c845-4155-aa43-5509a0f0d6b2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:06.920642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0556-5856-40da-bc35-46666824d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:06.921642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0556-5856-40da-bc35-46666824d25d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:06.922164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0556-5856-40da-bc35-46666824d25d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:06.923355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0556-5856-40da-bc35-46666824d25d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:06.927865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef90b1-2819-44d2-a38b-10d9e1b0e594 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:06.935217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f0556-5856-40da-bc35-46666824d25d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:06.941181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f0556-5856-40da-bc35-46666824d25d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-702f0556-5856-40da-bc35-46666824d25d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:06.956968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:06.958328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:06.959261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:06.965790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 347/695] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:06.973541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0556-5856-40da-bc35-46666824d25d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:06.990988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:06.991602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:06.991885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:06.992153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:06.992883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:06.993179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:06.994606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:07.012327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 349/696] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 15 07:17:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:07.019844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:07.095134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:07.154345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0556-5856-40da-bc35-46666824d25d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:07.208938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a3997-58bd-488f-aad8-db2eb81b1ae4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:07.223602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:07.224572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.225075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.225554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.226446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:07.226998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:07.228655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:07.237924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:07.244336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 348/697] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:07.258973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:07.271110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779018-8481-45ec-90d8-ef47f7b0eae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:07.271739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779018-8481-45ec-90d8-ef47f7b0eae5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.272009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779018-8481-45ec-90d8-ef47f7b0eae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.272277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779018-8481-45ec-90d8-ef47f7b0eae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.349988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779018-8481-45ec-90d8-ef47f7b0eae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:07.351896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779018-8481-45ec-90d8-ef47f7b0eae5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:07.394077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:07.486645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519dac4-9060-4ba2-9d7e-dccdf50e9acd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:07.501677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 350/698] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 07:17:07.503112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0c3f-3b84-41ac-b314-234116170d30 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.503396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0c3f-3b84-41ac-b314-234116170d30 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.503664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0c3f-3b84-41ac-b314-234116170d30 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.505071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 351/699] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:07.505910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856de88-23bf-4464-84bc-89eeb1518f8e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.506184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856de88-23bf-4464-84bc-89eeb1518f8e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.506447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856de88-23bf-4464-84bc-89eeb1518f8e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.507871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 352/700] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:07.508542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856de88-23bf-4464-84bc-89eeb1518f8e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:07.529214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a7f74-18d0-46ac-a883-9b9119efb2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:07.530249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7f74-18d0-46ac-a883-9b9119efb2aa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.530519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7f74-18d0-46ac-a883-9b9119efb2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.531074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7f74-18d0-46ac-a883-9b9119efb2aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.531806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a7f74-18d0-46ac-a883-9b9119efb2aa None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=ded85d4044b1442d95e53c859459738c) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:07.532268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a7f74-18d0-46ac-a883-9b9119efb2aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:07.534361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a7f74-18d0-46ac-a883-9b9119efb2aa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:07.540667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 349/701] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:07 2022] GET /identity/v3/role_assignments?user.id=ded85d4044b1442d95e53c859459738c&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:07.541806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c749267-d046-4943-bc4a-3a08ef6a6a6a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.542082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c749267-d046-4943-bc4a-3a08ef6a6a6a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.542342 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c749267-d046-4943-bc4a-3a08ef6a6a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.563797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7c749267-d046-4943-bc4a-3a08ef6a6a6a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:07.565221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c749267-d046-4943-bc4a-3a08ef6a6a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:07.637631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856de88-23bf-4464-84bc-89eeb1518f8e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:07.660324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:07.681842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 350/702] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:07.681842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ce9b-0fbe-4c9e-9dd9-8783b5df5e58 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.681842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ce9b-0fbe-4c9e-9dd9-8783b5df5e58 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.681842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ce9b-0fbe-4c9e-9dd9-8783b5df5e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.692973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:07.694065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.694532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.695064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.698665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1555ce9b-0fbe-4c9e-9dd9-8783b5df5e58 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:07.699925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1555ce9b-0fbe-4c9e-9dd9-8783b5df5e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:07.702542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:07.719016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:07.721111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:07.749491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:07.750578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:07.751551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:07.751551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:07.751551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:07.759348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 353/703] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:07.765462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:07.789578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 351/704] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:07.791416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b4c1-929c-4e15-9c65-cdca6a5ed599 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.791963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b4c1-929c-4e15-9c65-cdca6a5ed599 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.792235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b4c1-929c-4e15-9c65-cdca6a5ed599 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.794372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 352/705] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:07.804232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a3d5c-eab5-4509-8eb5-9854e4fa7ee4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.804511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a3d5c-eab5-4509-8eb5-9854e4fa7ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.804780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a3d5c-eab5-4509-8eb5-9854e4fa7ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.839952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-776a3d5c-eab5-4509-8eb5-9854e4fa7ee4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:07.841148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-776a3d5c-eab5-4509-8eb5-9854e4fa7ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:07.874717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec5e2-8dfa-4a8b-9e45-2aa6aef5532c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:07.908610 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:07.909261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:07.909537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:07.909806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:07.910474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:07.910774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:07.912245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:07.924644 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 354/706] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:07.930017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:07.965814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 353/707] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:07.992621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.050234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eecfa5-2f29-47a3-bf9b-0d12c70b699d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.070710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a3d5c-eab5-4509-8eb5-9854e4fa7ee4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.086855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.086855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.086855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.086855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.095894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.097477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:08.111723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:08.112687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:08.113601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 355/708] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:08.120387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.165375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.221537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6c5f5-a193-4e79-8a92-d03719aceddb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.228529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a3d5c-eab5-4509-8eb5-9854e4fa7ee4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.231216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.258600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.259427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.259769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.260196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.260860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.262288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.272249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.272891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.273162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.273430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:08.274657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:08.275861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:08.276888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:08.278271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 356/709] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:08.282853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.289639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.291156 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:08.306534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:08.307924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:08.308810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:08.308810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:08.308810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:08.308810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 354/710] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:08.308810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.396392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93d372-c9fe-401a-aeaa-326b82d92523 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.414505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b41db-0c3d-4f8e-8f10-61cf0700c5d5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.416871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.433548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.434222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.434505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.434774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.435500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:08.436211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.437665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.449229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.454634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 357/711] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:08.454766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.454766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.454954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.455025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] PATH_INFO: `/v3/services/network` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.455025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.455025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:08.466150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:08.467293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:08.468157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 355/712] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:08.468987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.495735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.570872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a34f-83c4-42b0-9b23-8107ad55d320 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.575421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea183-6368-41c8-9b77-bf6175e23b6a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.605649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.606260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.606548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.606798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.607458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:08.607755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.609127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.612338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.613007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.613411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.618299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.618423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 358/713] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:08.618544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:08.618544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.618679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.618749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.633231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 356/714] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:08.633231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.659525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.724098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.730424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f1ed9-b24a-4be5-9ed6-3882ebe1fdc9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.735066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b485d-e875-41c8-98ea-9f3e541dfe1c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.766097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.766888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.767169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.767501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.768248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=263fc62721954c23b0357d9e45447713) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:08.768577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.770008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.770373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.771020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.771300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.771570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.772197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] RBAC: Adding query filter params (name=network) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:08.772496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.774000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.787590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 359/715] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/role_assignments?user.id=263fc62721954c23b0357d9e45447713&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:08.787590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.789721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 357/716] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:08.790674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.905176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:08.908968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6429-7f64-46d3-b7a6-7b5e164d3f83 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.915049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729a410-7161-4a30-94d0-48bb83a09b88 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:08.952811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.953725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.953843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eaead-8177-4996-9da0-f17b04fb59d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:08.954272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.954598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eaead-8177-4996-9da0-f17b04fb59d6 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:08.954883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.954992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eaead-8177-4996-9da0-f17b04fb59d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:08.955332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eaead-8177-4996-9da0-f17b04fb59d6 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:08.956000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:08.956198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eaead-8177-4996-9da0-f17b04fb59d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.956582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:08.957817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eaead-8177-4996-9da0-f17b04fb59d6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.958248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:08.971165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 360/717] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:08.971165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:08.990049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 358/718] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:17:08 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:09.005133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:09.103594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32442-5324-45af-9b5e-f9958cddafa2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:09.143747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b600d04-7fed-47f9-be3a-a4c4f7a9c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:09.144392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600d04-7fed-47f9-be3a-a4c4f7a9c6fe None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:09.144666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600d04-7fed-47f9-be3a-a4c4f7a9c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:09.144932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600d04-7fed-47f9-be3a-a4c4f7a9c6fe None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:09.145584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b600d04-7fed-47f9-be3a-a4c4f7a9c6fe None admin] RBAC: Adding query filter params (type=network) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:09.145884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b600d04-7fed-47f9-be3a-a4c4f7a9c6fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:09.147473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b600d04-7fed-47f9-be3a-a4c4f7a9c6fe None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:09.153360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 361/719] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:09.869126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d72e-5d98-472b-893f-ac4ca41ff364 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:09.869523 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d72e-5d98-472b-893f-ac4ca41ff364 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:09.869724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d72e-5d98-472b-893f-ac4ca41ff364 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:09.871360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 359/720] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:09.876342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5bd2-a310-407f-b8f2-9fa406d0ccf7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:09.876785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5bd2-a310-407f-b8f2-9fa406d0ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:09.876862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5bd2-a310-407f-b8f2-9fa406d0ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:09.907904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5b6d5bd2-a310-407f-b8f2-9fa406d0ccf7 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:09.909216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5b6d5bd2-a310-407f-b8f2-9fa406d0ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:10.000717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 362/721] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:10.339652 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d72e-5d98-472b-893f-ac4ca41ff364 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:10.501477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d72e-5d98-472b-893f-ac4ca41ff364 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:10.545112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:10.545755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:10.546031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:10.546300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:10.559588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:10.564401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:10.565377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:10.566614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 360/722] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:10.573478 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5bd2-a310-407f-b8f2-9fa406d0ccf7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:10.598930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:10.707336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5bd2-a310-407f-b8f2-9fa406d0ccf7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:10.755519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:10.756522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:10.756995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:10.757485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:10.758345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:10.758858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:10.760433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:10.769344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 363/723] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:10.775297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:10.787111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:10.898496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641945d-c936-4493-bb14-8b1615c98869 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:10.939482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:10.940179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:10.940452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:10.940766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:10.957286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:10.958739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:10.977071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:10.978147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:10.979462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:10.979462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:10.979462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:10.979462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 361/724] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:10.985519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:11.090333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:11.118394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9c17-9adb-4acc-b78e-6ccf94fbbfcc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:11.162383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:11.162953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.163230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.163499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.164146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:11.164447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:11.165829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:11.178276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 364/725] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:11.184025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:11.287541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:11.335213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e6e1-22e0-48c8-9aa2-03c126355f21 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:11.370815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:11.372264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.372735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.373209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.381723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:11.383485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:11.395503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:11.396501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:11.397440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:11.400055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 362/726] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:17:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:11.405554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:11.541807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497777-a8b5-48c8-af15-ea4bbe4e3379 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:11.587824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a92bbc-9ad6-4726-a12a-6613cf5a94a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:11.588903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a92bbc-9ad6-4726-a12a-6613cf5a94a7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.589370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a92bbc-9ad6-4726-a12a-6613cf5a94a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.589854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a92bbc-9ad6-4726-a12a-6613cf5a94a7 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.590786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a92bbc-9ad6-4726-a12a-6613cf5a94a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:11.591317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a92bbc-9ad6-4726-a12a-6613cf5a94a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:11.593043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a92bbc-9ad6-4726-a12a-6613cf5a94a7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:11.606396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:11.633397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 365/727] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:17:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:11.638888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:11.707522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0aef6-0e84-4db9-bcad-4e6367ab5845 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.708165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0aef6-0e84-4db9-bcad-4e6367ab5845 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.708629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0aef6-0e84-4db9-bcad-4e6367ab5845 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.710508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 366/728] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:17:11.718867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e998e43-3aeb-4d83-9e35-ef2d503f1372 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.718867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e998e43-3aeb-4d83-9e35-ef2d503f1372 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.718867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e998e43-3aeb-4d83-9e35-ef2d503f1372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.752657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0e998e43-3aeb-4d83-9e35-ef2d503f1372 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:11.753875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0e998e43-3aeb-4d83-9e35-ef2d503f1372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:11.814798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86962c-86b9-4e9b-8566-0354961ff1c9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:11.837642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:11.852710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 367/729] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 07:17:11.858994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38355e-37cc-4be3-9d96-9078dc960664 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.858994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38355e-37cc-4be3-9d96-9078dc960664 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.858994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38355e-37cc-4be3-9d96-9078dc960664 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.860705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 368/730] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:11.862420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f846-8ce7-4af9-b9b9-d9aea6a18127 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.862785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f846-8ce7-4af9-b9b9-d9aea6a18127 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.863101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f846-8ce7-4af9-b9b9-d9aea6a18127 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.863574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aab04e-256b-4ead-a9d6-c09877f610f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:11.864238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab04e-256b-4ead-a9d6-c09877f610f0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.864516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab04e-256b-4ead-a9d6-c09877f610f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.864786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab04e-256b-4ead-a9d6-c09877f610f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.865785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 369/731] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:11.866933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb6b1e-7a27-4721-bf91-1996d4b1d8b3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.867218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb6b1e-7a27-4721-bf91-1996d4b1d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.867489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb6b1e-7a27-4721-bf91-1996d4b1d8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.881701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aab04e-256b-4ead-a9d6-c09877f610f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:11.883549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aab04e-256b-4ead-a9d6-c09877f610f0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:11.891761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-61fb6b1e-7a27-4721-bf91-1996d4b1d8b3 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:11.893199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-61fb6b1e-7a27-4721-bf91-1996d4b1d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b1aab04e-256b-4ead-a9d6-c09877f610f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:11.901026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:11.902191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:11.903335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:11.903335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:11.903335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:11.904234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 363/732] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:11.905581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996639-fe9e-4f5a-afc7-70e994c9ef93 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:11.906039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996639-fe9e-4f5a-afc7-70e994c9ef93 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:11.906498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996639-fe9e-4f5a-afc7-70e994c9ef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:11.929763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-03996639-fe9e-4f5a-afc7-70e994c9ef93 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:11.931904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-03996639-fe9e-4f5a-afc7-70e994c9ef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:11.974182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 370/733] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:11.975345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb6b1e-7a27-4721-bf91-1996d4b1d8b3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.019679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 364/734] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:12.021384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edd03-6938-4f6a-9a54-aa9f68e1a5ed None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.021673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edd03-6938-4f6a-9a54-aa9f68e1a5ed None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.021949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2edd03-6938-4f6a-9a54-aa9f68e1a5ed None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.023496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 365/735] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:12.029891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990338a-1b33-443f-82bc-05263e17b7c1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.030176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990338a-1b33-443f-82bc-05263e17b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.030449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990338a-1b33-443f-82bc-05263e17b7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.042922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.052376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a990338a-1b33-443f-82bc-05263e17b7c1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:12.053739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a990338a-1b33-443f-82bc-05263e17b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:12.097855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb6b1e-7a27-4721-bf91-1996d4b1d8b3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.138474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.139498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.139606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 366/736] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 07:17:12.140085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.146952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990338a-1b33-443f-82bc-05263e17b7c1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.147478 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.148410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:12.148909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:12.150488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:12.167730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 371/737] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:12.172908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.179280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.241074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990338a-1b33-443f-82bc-05263e17b7c1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.282854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.282854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.282854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.282854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.291494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:12.299827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:12.300737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:12.301658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 367/738] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:12.312039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.349397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26160d3a-3c35-4154-a6de-18230b2643ab None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.366431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.384348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.385061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.385329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.385597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.393266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:12.394807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:12.406324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:12.407426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 372/739] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:12.408315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.425624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.437075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8973d-0b2c-4db9-b677-1eecabd4f602 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.474666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.475606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.476028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.476438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.477284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:12.477737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:12.479288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:12.487687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 368/740] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:12.488536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.518399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495d3ee-9480-48a6-90c8-638563ffa1fa None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.551285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.551989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.552262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.552526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.553203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:12.554575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:12.571481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 373/741] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:12 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:12.572382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.604160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9ab4b-fd03-4fc0-9ef2-acfa61d73ef7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.631891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.653298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.653954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.654228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.654493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.666346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:12.672058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:12.673113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 369/742] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:12.674010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.689217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.714497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b75fb-5acd-4581-82db-02d8a08b5e9f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.752694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.753320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.753601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.753865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.754551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:12.754884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:12.756323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:12.769895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 374/743] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:12.770845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.790354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d06a-bb27-4665-ac76-90462ecea4d7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.823698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.824335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.824618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.824886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.836284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:12.838034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:12.854638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:12.855795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:12.856817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:12.856817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:12.856817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:12.858496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 370/744] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:12.859311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.879567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.883378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0de99-c009-4ce6-bc0a-52d513bbbf83 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:12.918090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:12.918716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:12.919009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:12.919288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:12.919927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:12.921290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:12.925958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:12.938880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 375/745] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:12 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:12.939923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:12.976650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e4c5-fea3-48cf-9479-5eca4481eb07 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.023898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.025059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.025642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.026151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.026943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:13.027308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.028949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.039464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 371/746] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:17:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:13.040534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.070707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decacf72-83f6-4a39-81a9-10d82a4ec499 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.119383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.120349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.120778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.121188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/ded85d4044b1442d95e53c859459738c/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.124642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=ded85d4044b1442d95e53c859459738c, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.126800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.147784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 376/747] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:17:12 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/ded85d4044b1442d95e53c859459738c/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:17:13.148912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.164311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe15c9-3db7-4e6f-bfdb-b4156e6caf5c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.179058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:13.190942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:13.216688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.218308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.219220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.219702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.220859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:13.221411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.224316 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.244743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 372/748] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:13.250014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.292642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f3abe-ad8f-484c-aadb-a5bebcedb406 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.334773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.335467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.335755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.336025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.350559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.352200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:13.370145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:13.371208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:13.372096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:13.372096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:13.372096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:13.375007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 377/749] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:13.380654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.396050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8125767-fd3f-4543-8bc7-e5f4a9a5474f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.453526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.455000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.456804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.457288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.469343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.473485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.490811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:13.495493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:13.496729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:13.497756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 373/750] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:13.504786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.536484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fc789-565d-41c9-bcf4-b1d25bcf61c7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.573577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.574597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.575103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.575572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.576415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:13.576912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.578495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.590683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:13.592450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 378/751] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:13.600957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.698529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfc88-d3ce-406a-8baf-b8ba050ff0fd None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.755703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.756383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.756660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.756927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.757658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:13.757958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.759443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.795705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 374/752] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:13.803815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.804263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17650d6-2b7d-4de8-b0f2-891b4fb8b219 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:13.836444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:13.843823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:13.844763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:13.845240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:13.845724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:13.853880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:13.855653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:13.867824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:13.868804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:13.869741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:13.872685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 379/753] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:13.878875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:13.986009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269346a-e435-4310-b548-9ef2e96f0e64 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:14.023092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:14.024251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:14.024803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:14.025296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:14.026226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:14.026724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:14.028527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:14.047212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 380/754] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:14.053051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:14.078610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:14.085653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c66663-7874-4b14-860b-ad9400873514 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:14.124450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:14.125476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:14.125980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:14.126454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:14.202010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:14.204054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:14.219179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:14.298878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea0f88-6b52-46d8-82f9-138e9624db6c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:14.311552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 375/755] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 07:17:14.312580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:14.318265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:14.400077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:14.400844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:14.400986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:14.401223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:14.423798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b780f73-e660-416e-ace2-3f5bdd2b4a13 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:14.461020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:14.462537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:14.463105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:14.463682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:14.475293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:14.477104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:14.492916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:14.493991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:14.494929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:14.494929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:14.494929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:14.497167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 376/756] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:14.504261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:14.547244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:14.548696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:14.592224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:14.649721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:14.688144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639afadf-c3cb-4358-99c1-5500bb068c86 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:14.735233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 381/757] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:14.738674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:14.751671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:14.752321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:14.752598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:14.752865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:14.753510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:14.753811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:14.755513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:14.778872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 377/758] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:14.786655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:14.908043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaf465-b587-4f48-80fc-292fd62e3936 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:14.984398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72e3ce-b85e-4bfe-954d-18f9f7e90b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:14.985325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3ce-b85e-4bfe-954d-18f9f7e90b82 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:14.985538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3ce-b85e-4bfe-954d-18f9f7e90b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:14.985804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3ce-b85e-4bfe-954d-18f9f7e90b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:14.998680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff107a-027c-421b-adde-0a21077712fb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.009288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72e3ce-b85e-4bfe-954d-18f9f7e90b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.010752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72e3ce-b85e-4bfe-954d-18f9f7e90b82 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.016463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:15.030010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3b72e3ce-b85e-4bfe-954d-18f9f7e90b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:15.042756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:15.043777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:15.044682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:15.044682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:15.044682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:15.044854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 382/759] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:15.046130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3a9dd-990d-4f1b-a5dd-9c63420ca6ed None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.046403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3a9dd-990d-4f1b-a5dd-9c63420ca6ed None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.046668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3a9dd-990d-4f1b-a5dd-9c63420ca6ed None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.048175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 383/760] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:15.048286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3651-6bcf-4afa-a297-b7563fe660b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.048836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3651-6bcf-4afa-a297-b7563fe660b9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.049118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3651-6bcf-4afa-a297-b7563fe660b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.049423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3651-6bcf-4afa-a297-b7563fe660b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.049923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3a9dd-990d-4f1b-a5dd-9c63420ca6ed None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.061442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3651-6bcf-4afa-a297-b7563fe660b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.063041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3651-6bcf-4afa-a297-b7563fe660b9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a01a3651-6bcf-4afa-a297-b7563fe660b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:15.075675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:15.076599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:15.077527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 378/761] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:15.078491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012dce2-3f35-4ffb-83b4-332eae4e8588 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.078657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012dce2-3f35-4ffb-83b4-332eae4e8588 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.083531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012dce2-3f35-4ffb-83b4-332eae4e8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.102665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5012dce2-3f35-4ffb-83b4-332eae4e8588 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:15.103980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5012dce2-3f35-4ffb-83b4-332eae4e8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:15.157858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3a9dd-990d-4f1b-a5dd-9c63420ca6ed None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.190887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 379/762] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:15.192054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012dce2-3f35-4ffb-83b4-332eae4e8588 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.200879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.201507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.201834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.202107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.202816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:15.203142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.204578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.230633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 384/763] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:15.235970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.325028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:15.328291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012dce2-3f35-4ffb-83b4-332eae4e8588 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.371740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:15.384993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.385610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.385878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.386138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.386857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:15.387158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.388609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.412014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 380/764] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:15.419729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.444712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c80d4-5581-4490-90d5-a8571747d679 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.529493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.530056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.530434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.530710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.538406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.540267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.553907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456d66c-4040-42cd-b70c-61d12200b1df None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:15.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:15.555336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:15.556241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 385/765] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:15.556720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.598496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.599158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.599430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.599702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.600547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=263fc62721954c23b0357d9e45447713) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:15.600853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.602450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.614982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 381/766] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/role_assignments?user.id=263fc62721954c23b0357d9e45447713&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:15.619034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.655463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:15.687343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca1f5b-c2db-48f3-b141-4a2fbcdaf677 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.711954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:15.732462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5af475-91c7-46e8-a220-ea2d89a1c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.733488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5af475-91c7-46e8-a220-ea2d89a1c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.733957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5af475-91c7-46e8-a220-ea2d89a1c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.734460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5af475-91c7-46e8-a220-ea2d89a1c8e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.735331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5af475-91c7-46e8-a220-ea2d89a1c8e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.737084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5af475-91c7-46e8-a220-ea2d89a1c8e3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.744428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7de007-2fd2-447f-bb0b-6546b09d8c2f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ec5af475-91c7-46e8-a220-ea2d89a1c8e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:15.747688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:15.748681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:15.749498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:15.751848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 386/767] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:15.753443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec7fe6-91b1-4a30-b487-44dfd96edf5e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.753721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec7fe6-91b1-4a30-b487-44dfd96edf5e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.753985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec7fe6-91b1-4a30-b487-44dfd96edf5e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.755674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 387/768] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:15.757236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1b43-3a4b-40dd-b5d3-31284332588a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.757514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1b43-3a4b-40dd-b5d3-31284332588a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.757878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1b43-3a4b-40dd-b5d3-31284332588a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.759737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 388/769] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:15.760404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a1b43-3a4b-40dd-b5d3-31284332588a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.788948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e05ac-d451-4ac8-ad00-758229f8130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.789486 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e05ac-d451-4ac8-ad00-758229f8130f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.789761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e05ac-d451-4ac8-ad00-758229f8130f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.790031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e05ac-d451-4ac8-ad00-758229f8130f None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.790738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e05ac-d451-4ac8-ad00-758229f8130f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:15.791076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e05ac-d451-4ac8-ad00-758229f8130f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.792570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e05ac-d451-4ac8-ad00-758229f8130f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.805327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 382/770] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:15.806716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0fc9d-0137-4363-be95-9a22b1c7f5bb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.807031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0fc9d-0137-4363-be95-9a22b1c7f5bb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.807301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0fc9d-0137-4363-be95-9a22b1c7f5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.825677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a2c0fc9d-0137-4363-be95-9a22b1c7f5bb None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:15.826896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a2c0fc9d-0137-4363-be95-9a22b1c7f5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:15.872999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a1b43-3a4b-40dd-b5d3-31284332588a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:15.902847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 383/771] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:15.902847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb861d3-a116-4463-b5d6-4c074144b3f2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.902847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb861d3-a116-4463-b5d6-4c074144b3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.902847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb861d3-a116-4463-b5d6-4c074144b3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.916665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:15.917438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:15.917770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:15.918176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:15.918896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] RBAC: Adding query filter params (name=network) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:15.919126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ebb861d3-a116-4463-b5d6-4c074144b3f2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:15.919273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:15.920312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ebb861d3-a116-4463-b5d6-4c074144b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:15.920932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:15.930385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 389/772] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:15.931365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:15.936392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:15.983994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:16.020892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 384/773] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:16.027007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb861d3-a116-4463-b5d6-4c074144b3f2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.061500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18fe80-ff14-403a-97ac-03c845734934 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.129145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.129870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.130141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.130502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.131266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:16.131565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:16.132984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:16.141297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 390/774] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:15 2022] GET /identity/v3/role_assignments?user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:16.174041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb861d3-a116-4463-b5d6-4c074144b3f2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.177077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.217858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.218490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.218755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.219054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.219700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:16.219997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:16.221686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:16.233808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 385/775] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:16.239941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.252670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:16.296189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816186b-e749-48a0-80e4-908c1c2f8ef9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.312097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:16.339810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.340878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.341360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.341829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.342657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:16.345454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:16.357630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:16.358713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:16.359963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:16.362952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 391/776] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:16.369170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.387608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40eda-9418-4ebc-b294-5647014ccba7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.436222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.436946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.437312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.437648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.438423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] RBAC: Adding query filter params (interface=public, service_id=e140742a16b341b197d4e7e84c3ab58f, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:16.438796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:16.440342 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:16.448583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 386/777] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/endpoints?service_id=e140742a16b341b197d4e7e84c3ab58f&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:16.449585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.496141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e5f47-0667-430c-8a29-69ad3a0ab291 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.523687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:16.541993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.542737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.543121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.543457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.560057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:16.562766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fbcca-fd9b-44e8-bf62-fb3d5388f185 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:16.567465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:16.568398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:16.569326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:16.571896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 392/778] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:16.573030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.605792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.607094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.607728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.608098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.608859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:16.609500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:16.611837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:16.616771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:16.622908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 387/779] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:16.622908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.707332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbcda9-dfeb-433e-a093-2c0f9ad5aec2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.746266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.747196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.747609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.748037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.750368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:16.751923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:16.757753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 393/780] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:16.758715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.765581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9ad8-2ace-4597-a156-2a464bf0998c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:16.837429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:16.838357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:16.838801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:16.839251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:16.840087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:16.840548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:16.842137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:16.855226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:16.858975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 388/781] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:16.866001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:16.956608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:16.961363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe56db-9ea7-46e3-aa45-11bc6f820a4a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cba775-b127-4efe-9424-2b90fba50943 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.037538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.038326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.038694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.039228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:17.039843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:17.040241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:17.041721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:17.052242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 394/782] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:17.059437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:17.079338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.079985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.080263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.080643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:17.091996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:17.093411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:17.110597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:17.111765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:17.112655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:17.112655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:17.112655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:17.112655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 389/783] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:17.117623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:17.168029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e1f0-7270-431b-bef9-4431f0703258 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.172940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:17.203842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.204547 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.204915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.205272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:17.206236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] RBAC: Adding query filter params (interface=public, service_id=f0aa1360e62949d79f0d0d3d9beebbac, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:17.206669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:17.208229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:17.218459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 395/784] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:17:17 2022] GET /identity/v3/endpoints?service_id=f0aa1360e62949d79f0d0d3d9beebbac&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:17.224608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:17.235165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10dfe4-46c8-4106-9c2b-204d696df2d2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.252776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:17.275284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.276169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.276622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.277081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:17.277864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:17.278346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:17.280070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:17.293649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 390/785] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:17.299840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:17.325278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d2a7-e8ab-419a-936d-3354ff15e6f4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.361295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.362023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.362385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.363377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:17.363377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:17.364914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:17.374907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 396/786] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:17 2022] GET /identity/v3/services => generated 772 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:17.503470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc242b-b866-4b15-8b76-cace0bcfdb09 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.520364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:17.550807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.551485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.551758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.552030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:17.559749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:17.561222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:17.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:17.574779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:17.575766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 391/787] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:17:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:17.580447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:17.685405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:17.694148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0031e-7a1a-420f-a057-744d4e4de81f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.748601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9372d69-8252-412e-9fc3-073b20599081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.749226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372d69-8252-412e-9fc3-073b20599081 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.749504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372d69-8252-412e-9fc3-073b20599081 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.749776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372d69-8252-412e-9fc3-073b20599081 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:17.750516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9372d69-8252-412e-9fc3-073b20599081 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:17.750833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9372d69-8252-412e-9fc3-073b20599081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:17.752330 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9372d69-8252-412e-9fc3-073b20599081 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:17.779902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 397/788] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:17:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:17.785410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:17.923932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f7596-dbf3-44c5-927c-0bd462a0a053 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:17.970369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:17.971290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:17.971574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:17.971843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.032723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:18.074049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:18.075578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:18.106226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5635e-a79b-4ab7-8616-8dffc61ff6cc None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:18.106508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5635e-a79b-4ab7-8616-8dffc61ff6cc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:18.106784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5635e-a79b-4ab7-8616-8dffc61ff6cc None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.108149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 398/789] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:18.116030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ae168-8baf-4519-8643-e2d0c042a4dc None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:18.116311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ae168-8baf-4519-8643-e2d0c042a4dc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:18.116584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ae168-8baf-4519-8643-e2d0c042a4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.205817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 392/790] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:18.207389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:18.266330 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-277ae168-8baf-4519-8643-e2d0c042a4dc None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:18.267598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-277ae168-8baf-4519-8643-e2d0c042a4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:18.332539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:18.340850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 399/791] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:18.368399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8477-804c-4749-9a79-7e3be1b8f4db None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:18.403881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba125b62-65f2-49fd-8d00-9595dadc9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:18.404521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba125b62-65f2-49fd-8d00-9595dadc9e68 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:18.404798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba125b62-65f2-49fd-8d00-9595dadc9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:18.405071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba125b62-65f2-49fd-8d00-9595dadc9e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.423854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba125b62-65f2-49fd-8d00-9595dadc9e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:18.425401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba125b62-65f2-49fd-8d00-9595dadc9e68 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-ba125b62-65f2-49fd-8d00-9595dadc9e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:18.441176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:18.442161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:18.443092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:18.443092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:18.443092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:18.447309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 393/792] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:18.452801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ae168-8baf-4519-8643-e2d0c042a4dc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:18.565196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:18.590631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ae168-8baf-4519-8643-e2d0c042a4dc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:18.644679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:18.645303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:18.645581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:18.645848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.646499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:18.646799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:18.648204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:18.670285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 400/793] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:18.676121 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc364ff-cb2e-4604-bbb2-a4e87ab00416 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:18.676582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc364ff-cb2e-4604-bbb2-a4e87ab00416 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:18.676658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc364ff-cb2e-4604-bbb2-a4e87ab00416 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.677988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 394/794] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:18.678976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:18.683679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f327b12-82fd-4a5d-95c6-dc35181acd57 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:18.683957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f327b12-82fd-4a5d-95c6-dc35181acd57 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:18.684226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f327b12-82fd-4a5d-95c6-dc35181acd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.715247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3f327b12-82fd-4a5d-95c6-dc35181acd57 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:18.716448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3f327b12-82fd-4a5d-95c6-dc35181acd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:18.797800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bf22a-b75f-4b27-b4fc-309cfcd56954 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:18.825128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 395/795] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:18.825128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f327b12-82fd-4a5d-95c6-dc35181acd57 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:18.847623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:18.848620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:18.849130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:18.849438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:18.863809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:18.865330 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:18.873537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:18.882745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:18.888268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:18.889154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:18.890086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 401/796] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:18.896589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:18.988629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f327b12-82fd-4a5d-95c6-dc35181acd57 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.023737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f942d-8b06-408f-b7e2-3d705bc638ca None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.042225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.043120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.043461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.043790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.060580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.061490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.062205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.062648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.063534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:19.064226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.066054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:19.066803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:19.071983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:19.072971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:19.073801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:19.079361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 396/797] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:19.079852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.083331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 402/798] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:19.090023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.175363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:19.221343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bf133-f383-4648-997f-f4e7c197936c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.228150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2624-f404-4872-8a64-3c269efd6fbc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.242209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:19.262356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.263012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.263288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.263555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.264283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=ded85d4044b1442d95e53c859459738c) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:19.264612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.266038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:19.267375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.268288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.268770 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.269231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.270110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:19.270882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.272399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 403/799] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/role_assignments?user.id=ded85d4044b1442d95e53c859459738c&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:19.272817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:19.273189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.285044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 397/800] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:19.291898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.401119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e0c2-0ca2-4cf0-b2e6-027a01d28a5c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.405617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c9120-2bf6-429d-98b0-1ef59a4a4a3c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.431880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:19.446000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.447011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.447427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.447658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.448070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.448354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.448727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.449123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.461162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.461718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:19.463012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:19.467890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:19.469099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:19.470162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:19.473056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 404/801] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:19.480124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:19.495831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:19.496866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:19.497763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:19.497763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:19.497763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:19.498382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 398/802] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:19.503809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.541459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:19.618412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95d119-c50a-42cf-99db-773f0d820745 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.655798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.656432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.656799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.657139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.657865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:19.658234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.659834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:19.675462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 399/803] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:19.683338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.694524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d157-b678-42d8-b845-e0881365de5d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.740108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.740724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.740997 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.741261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.741929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:19.742228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.743649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:19.752467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 405/804] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:19.763892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.790089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:19.807641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a1ec1-90b5-4e26-bc34-550f8d57bb45 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.844291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:19.905405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661405f-78eb-4a9b-84b7-dac7b6716c14 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:19.943117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1807a4f-ea33-4907-a318-df6665eb5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.943695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1807a4f-ea33-4907-a318-df6665eb5d96 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.943968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1807a4f-ea33-4907-a318-df6665eb5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.944231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1807a4f-ea33-4907-a318-df6665eb5d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.956686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1807a4f-ea33-4907-a318-df6665eb5d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.958180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1807a4f-ea33-4907-a318-df6665eb5d96 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a1807a4f-ea33-4907-a318-df6665eb5d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:19.974296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:19.975389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:19.976267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:19.976267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:19.976267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:19.976267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 406/805] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:19.981759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2e5b-4f18-4b98-b89b-6cef7b035c49 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.981759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2e5b-4f18-4b98-b89b-6cef7b035c49 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.981759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2e5b-4f18-4b98-b89b-6cef7b035c49 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.982890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 407/806] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:19.983929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af2e5b-4f18-4b98-b89b-6cef7b035c49 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:19.984035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f07db-8ba6-4603-a2fb-81b8db414a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:19.984679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f07db-8ba6-4603-a2fb-81b8db414a2e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:19.984958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f07db-8ba6-4603-a2fb-81b8db414a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:19.985231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f07db-8ba6-4603-a2fb-81b8db414a2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:19.994431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f07db-8ba6-4603-a2fb-81b8db414a2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:19.996496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f07db-8ba6-4603-a2fb-81b8db414a2e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c93f07db-8ba6-4603-a2fb-81b8db414a2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:20.012152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:20.013160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:20.014108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 400/807] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:20.015273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4f504-9b7f-437f-8843-b29a773652fa None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.015273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4f504-9b7f-437f-8843-b29a773652fa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.015538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4f504-9b7f-437f-8843-b29a773652fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.038923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-28b4f504-9b7f-437f-8843-b29a773652fa None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:20.040828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-28b4f504-9b7f-437f-8843-b29a773652fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:20.092187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:20.098051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af2e5b-4f18-4b98-b89b-6cef7b035c49 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.122854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 401/808] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:20.122854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4f504-9b7f-437f-8843-b29a773652fa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.139588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d560b2a-c418-44ee-b984-0e73ebb147bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.140294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d560b2a-c418-44ee-b984-0e73ebb147bf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.140642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d560b2a-c418-44ee-b984-0e73ebb147bf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.140976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d560b2a-c418-44ee-b984-0e73ebb147bf None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.141626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d560b2a-c418-44ee-b984-0e73ebb147bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:20.141925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d560b2a-c418-44ee-b984-0e73ebb147bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.143395 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d560b2a-c418-44ee-b984-0e73ebb147bf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.158889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 408/809] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:20.160456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fc689-bb19-4bc5-a2d4-7de7dd081f43 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.160736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fc689-bb19-4bc5-a2d4-7de7dd081f43 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.161007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fc689-bb19-4bc5-a2d4-7de7dd081f43 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.166634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 409/810] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:20.167540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fc689-bb19-4bc5-a2d4-7de7dd081f43 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.203370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:20.226748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4f504-9b7f-437f-8843-b29a773652fa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.260263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33596a-7830-40c9-a9e1-79993a69b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.261217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33596a-7830-40c9-a9e1-79993a69b5dd None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.261797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33596a-7830-40c9-a9e1-79993a69b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.262256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33596a-7830-40c9-a9e1-79993a69b5dd None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.263233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33596a-7830-40c9-a9e1-79993a69b5dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:20.263755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33596a-7830-40c9-a9e1-79993a69b5dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.265389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33596a-7830-40c9-a9e1-79993a69b5dd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.280765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fc689-bb19-4bc5-a2d4-7de7dd081f43 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.286058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 402/811] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:20.287593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aee787-d192-49ec-8293-72da5438115f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.287946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aee787-d192-49ec-8293-72da5438115f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.288289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aee787-d192-49ec-8293-72da5438115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.313281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-92aee787-d192-49ec-8293-72da5438115f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:20.314867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-92aee787-d192-49ec-8293-72da5438115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:20.324946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.326219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.326564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.326931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.336189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.337731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:20.352526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:20.353542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:20.354485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:20.358578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 410/812] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:20.360555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.383353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:20.394630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 403/813] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:20.395779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aee787-d192-49ec-8293-72da5438115f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.459238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:20.486624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c21ca4-1135-4c0e-9e36-c7478f9f7bb7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.499072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aee787-d192-49ec-8293-72da5438115f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.528898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.529793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.530220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.530930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.537056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.537777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.538146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.538505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.539414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:20.539814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.542864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.544202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.545973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.567308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 404/814] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:20.567308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:20.567722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:20.568713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:20.569619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:20.569619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:20.569619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:20.571349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 411/815] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:20.573745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.666483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:20.692964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14047a56-c0c2-46b4-a831-a88005a9f5ec None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.706600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f168308-e538-4fd7-881b-6bb7bd47ba74 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.716005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:20.728690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.729322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.729598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.729864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.730451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.731874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:20.740657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:20.741681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:20.742519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 405/816] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:20.743943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.755321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.755968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.756245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.756511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.769743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.771291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:20.787703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:20.788670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:20.789987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:20.789987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:20.789987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:20.789987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 412/817] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:20.789987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.863951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436a36b-50d8-45a7-990c-063ccbc2b9c7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.899320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2e302-f71a-43bd-bcaf-8d3ceaf82bd7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:20.899514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.899975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.900251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.900524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.901172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:20.901470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.902873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.915244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 406/818] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:20.920449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.922552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:20.935030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:20.935667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:20.935942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:20.936212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:20.936801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:20.938179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:20.947758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:20.948795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:20.949650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 413/819] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:20.950464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:20.974254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.027538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4661e7-9807-4813-8fe5-caed7d1151e3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.059074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e581-fbdf-49f3-b747-be142ae46dca None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.060689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.061300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.061572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.061838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.062464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] RBAC: Adding query filter params (name=network) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:21.062759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.064154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.068916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 407/820] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:21.069594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.106287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.106943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.107205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.107471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.108113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:21.108413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.109848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.122356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 414/821] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:21.123273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.174166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.188616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357edf3-80d8-462d-82ee-36a6074d124d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.200136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.226714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.227306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.227589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.227856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.231238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30b17-b667-4433-8f8e-5b53116507da None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.234510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.235998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:21.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:21.248091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:21.248989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 408/822] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:21.249703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.269304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.269965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.270324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.270606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.271240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:21.271541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.273016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.281883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 415/823] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 15 07:17:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:21.281883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.361822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab14bc-fe18-4475-bbbe-36a08c826761 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.388482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf189-1073-4c01-a9d4-d15616ba8a85 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.394147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.394769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.395083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.395350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.395984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:21.396282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.397663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.401361 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.407547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 409/824] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:21.407547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.440334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.441500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.442382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.442663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.443083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.451424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.452876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:21.465138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:21.466042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 416/825] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:21.467419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.512683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb8d2-b92c-4454-9a95-d1980f750ee0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.545386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.545997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.546270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.546540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.547258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:21.547556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.549047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.560781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 410/826] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:21.561550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.581255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345a26c-2dc6-40fd-9689-4914aa321ce1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.623818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.624756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.625272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.626219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.626708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:21.627088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.628461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.638654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 417/827] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 15 07:17:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:21.638654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.666977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.674799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.676399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0cc6b-60fb-44ea-86a2-23852ebc884f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.712511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.713169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.713396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.713666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.714342 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.715766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.740144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 411/828] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:21.740970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.761039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1932d-2b34-46b4-b314-5c492e7aa493 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.811481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.812018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.812297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.812570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.813315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:21.813669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.815233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.833226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 418/829] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:21.833226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.876564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc58ef-8893-4699-83a5-e6eb2642f21b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.915064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b9ea8-7cb0-4aac-b5a3-c462e5479b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:21.915850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9ea8-7cb0-4aac-b5a3-c462e5479b0b None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.916124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9ea8-7cb0-4aac-b5a3-c462e5479b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.916393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9ea8-7cb0-4aac-b5a3-c462e5479b0b None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/263fc62721954c23b0357d9e45447713/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.918462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b9ea8-7cb0-4aac-b5a3-c462e5479b0b None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=263fc62721954c23b0357d9e45447713, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:21.919948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b9ea8-7cb0-4aac-b5a3-c462e5479b0b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:21.932550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:21.938344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 412/830] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:17:21 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/263fc62721954c23b0357d9e45447713/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:17:21.939748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dcd82-dbc0-479d-b2f0-79a775d0cec1 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:21.940027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dcd82-dbc0-479d-b2f0-79a775d0cec1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:21.940296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dcd82-dbc0-479d-b2f0-79a775d0cec1 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:21.941533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 413/831] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:21.942220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dcd82-dbc0-479d-b2f0-79a775d0cec1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:21.951616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903632d-4b07-4974-8eaf-d24224276dc2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:21.956565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:22.002511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d54b2-733d-43e4-ac0b-2dd1645ccc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:22.003534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d54b2-733d-43e4-ac0b-2dd1645ccc42 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:22.004385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d54b2-733d-43e4-ac0b-2dd1645ccc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:22.004811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d54b2-733d-43e4-ac0b-2dd1645ccc42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:22.006029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d54b2-733d-43e4-ac0b-2dd1645ccc42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:22.008000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d54b2-733d-43e4-ac0b-2dd1645ccc42 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:22.038919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 419/832] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:22.040349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d3cad-05ef-4c71-898c-9fb5131f23e8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:22.040634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d3cad-05ef-4c71-898c-9fb5131f23e8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:22.040910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d3cad-05ef-4c71-898c-9fb5131f23e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:22.064331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5d3d3cad-05ef-4c71-898c-9fb5131f23e8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:22.065850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5d3d3cad-05ef-4c71-898c-9fb5131f23e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:22.089869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dcd82-dbc0-479d-b2f0-79a775d0cec1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:22.138329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:22.139747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:22.140229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:22.140695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/77673f0ca55f4eeb9fbee6d9c48dc4e6/roles/19bf489599ed454d89d91d959f899a44` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:22.152650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 420/833] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:22.161759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=77673f0ca55f4eeb9fbee6d9c48dc4e6, role_id=19bf489599ed454d89d91d959f899a44)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:22.163344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:22.179465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 414/834] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:17:21 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/77673f0ca55f4eeb9fbee6d9c48dc4e6/roles/19bf489599ed454d89d91d959f899a44 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:17:22.427221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d3cad-05ef-4c71-898c-9fb5131f23e8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:22.503309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:22.526177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d3cad-05ef-4c71-898c-9fb5131f23e8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:22.559875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:22.560515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:22.560845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:22.561114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:22.561709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:22.563111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:22.572321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:22.573298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:22.574228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 421/835] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Sep 15 07:17:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:22.579671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:22.638755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:22.685262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee65dcc-e437-4ad4-8baf-36b163a74493 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:22.720419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccd500-9805-43b5-90e6-cef2956a8391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:22.721273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccd500-9805-43b5-90e6-cef2956a8391 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:22.721430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccd500-9805-43b5-90e6-cef2956a8391 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:22.721631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccd500-9805-43b5-90e6-cef2956a8391 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:22.722629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccd500-9805-43b5-90e6-cef2956a8391 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:22.722958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccd500-9805-43b5-90e6-cef2956a8391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:22.724343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccd500-9805-43b5-90e6-cef2956a8391 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:22.729406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 415/836] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:22.735205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:22.833590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8b90-931b-4063-9ed7-0a2886aaf6e5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:22.867004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067718d3-9153-4015-b976-def91085f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:22.867622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067718d3-9153-4015-b976-def91085f343 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:22.867899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067718d3-9153-4015-b976-def91085f343 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:22.868167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067718d3-9153-4015-b976-def91085f343 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:22.868803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067718d3-9153-4015-b976-def91085f343 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:22.869097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067718d3-9153-4015-b976-def91085f343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:22.870593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067718d3-9153-4015-b976-def91085f343 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:22.875380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 422/837] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:24.205068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d6ea-f7ce-40d8-90cb-4827cda05091 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.206089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d6ea-f7ce-40d8-90cb-4827cda05091 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.206642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d6ea-f7ce-40d8-90cb-4827cda05091 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.208495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 416/838] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:24.213868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db44c-4938-4b8a-bf58-6b07f9abdb91 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.214637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db44c-4938-4b8a-bf58-6b07f9abdb91 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.215133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db44c-4938-4b8a-bf58-6b07f9abdb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.223202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:24.237159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-359db44c-4938-4b8a-bf58-6b07f9abdb91 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:24.238769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-359db44c-4938-4b8a-bf58-6b07f9abdb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:24.287600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96228cf-2479-47d4-8437-05b49a1579c2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.287939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96228cf-2479-47d4-8437-05b49a1579c2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.288154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96228cf-2479-47d4-8437-05b49a1579c2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.289749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 417/839] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:24.294904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b69d7-fff3-45b8-998c-ad55500ab253 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.295419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b69d7-fff3-45b8-998c-ad55500ab253 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.295885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b69d7-fff3-45b8-998c-ad55500ab253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.308794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 423/840] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:24.321605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-007b69d7-fff3-45b8-998c-ad55500ab253 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:24.322855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-007b69d7-fff3-45b8-998c-ad55500ab253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:24.391921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 418/841] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:24.435608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7377-c970-4901-adac-56364e1ba025 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.435937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7377-c970-4901-adac-56364e1ba025 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.436194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7377-c970-4901-adac-56364e1ba025 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.437828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 424/842] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:24.444249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e679649-af58-4cd6-a0fa-c31d71c16b04 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.444533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e679649-af58-4cd6-a0fa-c31d71c16b04 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.444807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e679649-af58-4cd6-a0fa-c31d71c16b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.463382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6e679649-af58-4cd6-a0fa-c31d71c16b04 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:24.464490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6e679649-af58-4cd6-a0fa-c31d71c16b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:24.511157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:24.538940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 419/843] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:24.580730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc7377-c970-4901-adac-56364e1ba025 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:24.689913 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc7377-c970-4901-adac-56364e1ba025 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:24.692017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e679649-af58-4cd6-a0fa-c31d71c16b04 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:24.732082 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:24.733077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.733450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.733717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.735723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:24.746298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:24.752424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:24.753364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:24.754613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 425/844] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:24.760662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:24.814047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e679649-af58-4cd6-a0fa-c31d71c16b04 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:24.850108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:24.850759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.851056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.851294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.851879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:24.853254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:24.861939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:24.863464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:24.864661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 420/845] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:24.865451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:24.873110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9c01-db68-4f21-ad1a-980ee9ac77fc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:24.909450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:24.910958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:24.911720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:24.911898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:24.912120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:24.912808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:24.913096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:24.914508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:24.928486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 426/846] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:24.928486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:24.974100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa7fa-c6dc-40d1-9d14-691316a3fb26 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:24.988232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.007509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.008198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.008472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.008737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.019060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:25.024154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:25.025081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:25.025939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 421/847] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:17:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:25.026640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.041051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951da41-4c1b-4b10-9bb9-20a02f458875 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.074308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.074955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.075236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.075505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.076137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:25.076435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.077819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.082680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 427/848] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:25.083546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.132531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f8bac-8ac9-4e5a-abb3-a43f2c50f3a7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.135282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.166672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f8d6-b845-447a-a655-b5510a7c249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.167331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f8d6-b845-447a-a655-b5510a7c249d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.167604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f8d6-b845-447a-a655-b5510a7c249d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.167870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f8d6-b845-447a-a655-b5510a7c249d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.178178 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f8d6-b845-447a-a655-b5510a7c249d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.179646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f8d6-b845-447a-a655-b5510a7c249d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.184287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8788cd-484b-4604-abd3-ce7f89f7e7cd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c846f8d6-b845-447a-a655-b5510a7c249d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:25.193329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:25.194320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:25.195278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:25.195278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:25.195278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:25.195278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 422/849] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:25.195515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903370e5-39a8-43b5-90f8-f80e41645793 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.195948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903370e5-39a8-43b5-90f8-f80e41645793 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.196129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903370e5-39a8-43b5-90f8-f80e41645793 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.198574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 423/850] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:25.198574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903370e5-39a8-43b5-90f8-f80e41645793 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.205995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.220800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.221525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.221723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.222334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.223026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:25.223332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.224694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.232682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 428/851] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:25.233460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.305028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903370e5-39a8-43b5-90f8-f80e41645793 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.329909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc796cbe-b6b4-4e0d-8878-5e72acfb3d95 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.337919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43d08c-29f6-4265-bbc7-67ee189486bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.338524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d08c-29f6-4265-bbc7-67ee189486bf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.338799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d08c-29f6-4265-bbc7-67ee189486bf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.339093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d08c-29f6-4265-bbc7-67ee189486bf None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.339719 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d08c-29f6-4265-bbc7-67ee189486bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:25.340016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d08c-29f6-4265-bbc7-67ee189486bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.341386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d08c-29f6-4265-bbc7-67ee189486bf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.345787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 424/852] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:25.347347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add1cd-9eef-4740-9ba3-033a313957ed None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.347633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add1cd-9eef-4740-9ba3-033a313957ed None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.347902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add1cd-9eef-4740-9ba3-033a313957ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.366104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.366741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.366860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-92add1cd-9eef-4740-9ba3-033a313957ed None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:25.367061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.367322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.367988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:25.368090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-92add1cd-9eef-4740-9ba3-033a313957ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:25.368287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.369686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.383039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 429/853] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:25.383770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.389348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.435219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.456699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 425/854] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:25.457424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add1cd-9eef-4740-9ba3-033a313957ed None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.519713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51bc2-9ea9-489d-a036-a846e86a56f0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.560443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.561001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.561278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.561546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.573267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.574170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add1cd-9eef-4740-9ba3-033a313957ed None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.574733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:25.591687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:25.592718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:25.594249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:25.594249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:25.594249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:25.594249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 430/855] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:25.600427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.627147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.627632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.627904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.628172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.636202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.637843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:25.652633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:25.653625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:25.654580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 426/856] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:25.660504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.676607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.712652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.722321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba54f1a-ae4a-4384-a220-84b310007d83 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.760638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.761529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.761806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.762080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.762722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:25.763068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.764849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.776732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb35d5-f8e6-4991-82a1-916481bd2dfa None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.781736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 431/857] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:25.781736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.816346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.816893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.817162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.817420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.818292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:25.818416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.819898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.838048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 427/858] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:25.838690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.893688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67ba96-2f8d-4804-80d2-49d5e0fee57c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.904924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.931831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.932444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.932721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.932992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.933642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.935039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:25.939831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898701-8aa9-4e8d-810a-5befd48c83f6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:25.959263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 432/859] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:25 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:25.960275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:25.983853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:25.984500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:25.984776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:25.985033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:25.991042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:25.994071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:25.995786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:26.010509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:26.011643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:26.012595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:26.016702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 428/860] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:26.017797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.123291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2057d-5711-45d5-9e45-bbffa8f11bf4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.127974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d837-e22d-4b57-ac89-540aa3c9bb88 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.154948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:26.172194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.172813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.173085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.173346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.174277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.174938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.175210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.175474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.176163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:26.176708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.178621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.199075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 429/861] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:26.205175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.247835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.249322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.266987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:26.337530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080e273-424c-4a4d-8ef7-9def319da2f6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.373965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 433/862] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:25 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:26.379741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.383598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.383844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.384062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.384329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.434787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:26.456487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.457969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.505793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79214160-d506-41f0-ad74-e6900befebe7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.523991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:26.548017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.548761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.549124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.549482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.561962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.563839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.568705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 430/863] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:26.574459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:26.582683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:26.583844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:26.584756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:26.584756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:26.584756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:26.590996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 434/864] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:26.592700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.680717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:26.703833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23cd62-2b4d-4e71-9189-762418d01dc5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.717125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8cbf4-1e4f-49b9-a537-7c48fd5ead10 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.742816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.743941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.744417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.744901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.754813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.755248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.755518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.755784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.756420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:26.756714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.757967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.758080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.759860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.776528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 435/865] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:26.778584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:26.779676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:26.780588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:26.780588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:26.780588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:26.781172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.784418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 431/866] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:26.785382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.813154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:26.897209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66990-84ee-428c-bc09-c889124eb270 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.920356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99885ec-964f-4017-be0e-4cc9f5457f2c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:26.933128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.933920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.934400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.934643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.942068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.943676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:26.955715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:26.956796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:26.957904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:26.963109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:26.963247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 436/867] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:26.963963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:26.964374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:26.964766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:26.965449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:26.965703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:26.966230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:26.967759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:26.970747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:26.989536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 432/868] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:26.990552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:27.073587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:27.091935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56602d1-ad4c-4824-ae47-c3c7335bde0d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:27.095572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd1b82-502b-46d8-b3fc-64e03581c7f4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:27.131938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:27.132718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:27.133035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:27.133375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:27.133865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:27.134761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:27.135205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:27.135620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:27.136573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:27.137303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:27.138888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:27.141917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:27.143616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:27.153034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 437/869] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:27.159037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:27.161185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:27.162073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:27.163029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 433/870] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:27.168141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:27.229398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:27.277281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63ae4e-b07c-41f3-8e9a-5ec2e493f432 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:27.288607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5edeb-51c7-434f-9bb4-b02233a915d4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:27.315314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:27.316166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:27.316426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:27.316698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:27.317427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=263fc62721954c23b0357d9e45447713) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:27.317801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:27.319527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:27.331027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af52642-71b4-499b-843d-1a81c884c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:27.331215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 438/871] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:27 2022] GET /identity/v3/role_assignments?user.id=263fc62721954c23b0357d9e45447713&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:27.332022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af52642-71b4-499b-843d-1a81c884c227 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:27.332467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af52642-71b4-499b-843d-1a81c884c227 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:27.332923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af52642-71b4-499b-843d-1a81c884c227 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:27.333792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af52642-71b4-499b-843d-1a81c884c227 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:27.334262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af52642-71b4-499b-843d-1a81c884c227 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:27.336020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af52642-71b4-499b-843d-1a81c884c227 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:27.351173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 434/872] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:27.360231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:27.379210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:27.473159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29e56-87b5-409c-b262-24070d97a212 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:27.511061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1be9-6ce1-4be2-b8d2-9f72009df14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:27.512001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1be9-6ce1-4be2-b8d2-9f72009df14e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:27.512560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1be9-6ce1-4be2-b8d2-9f72009df14e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:27.512996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1be9-6ce1-4be2-b8d2-9f72009df14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:27.513910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1be9-6ce1-4be2-b8d2-9f72009df14e None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:27.514385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1be9-6ce1-4be2-b8d2-9f72009df14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:27.516034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1be9-6ce1-4be2-b8d2-9f72009df14e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:27.523365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 439/873] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:27 2022] GET /identity/v3/role_assignments?user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:27.575555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8fd3-9383-4170-a646-a4bf5f0ab61e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:27.575912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8fd3-9383-4170-a646-a4bf5f0ab61e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:27.576268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8fd3-9383-4170-a646-a4bf5f0ab61e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:27.578008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 435/874] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:27.584214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e48ed-3083-4b53-b4f6-dcb4779de009 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:27.584480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e48ed-3083-4b53-b4f6-dcb4779de009 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:27.584754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e48ed-3083-4b53-b4f6-dcb4779de009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:27.606339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-939e48ed-3083-4b53-b4f6-dcb4779de009 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:27.607609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-939e48ed-3083-4b53-b4f6-dcb4779de009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:27.681591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 440/875] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:27 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:27.946591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8fd3-9383-4170-a646-a4bf5f0ab61e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:28.055113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8fd3-9383-4170-a646-a4bf5f0ab61e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:28.072483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:28.093824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfacc83-5085-499f-a971-99e5a00aac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:28.094444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc83-5085-499f-a971-99e5a00aac42 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:28.094716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc83-5085-499f-a971-99e5a00aac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:28.095005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc83-5085-499f-a971-99e5a00aac42 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:28.095701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfacc83-5085-499f-a971-99e5a00aac42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:28.097541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfacc83-5085-499f-a971-99e5a00aac42 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:28.119089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 436/876] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:27 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:28.159676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176a0a-0713-478e-9d94-6996d57ceea9 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:28.159948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176a0a-0713-478e-9d94-6996d57ceea9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:28.160324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176a0a-0713-478e-9d94-6996d57ceea9 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:28.162121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 441/877] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:28.168165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bc649-b0c4-4695-a76e-583f4d89fe8c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:28.168456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bc649-b0c4-4695-a76e-583f4d89fe8c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:28.168718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bc649-b0c4-4695-a76e-583f4d89fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:28.188530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8a6bc649-b0c4-4695-a76e-583f4d89fe8c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:28.189880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8a6bc649-b0c4-4695-a76e-583f4d89fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:28.275055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 437/878] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:28.532891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176a0a-0713-478e-9d94-6996d57ceea9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:28.536957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:28.637557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176a0a-0713-478e-9d94-6996d57ceea9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:28.673276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:28.673956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:28.674227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:28.674491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:28.675105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:28.676522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:28.685552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:28.686480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:28.687418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 442/879] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Sep 15 07:17:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:28.692827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bc649-b0c4-4695-a76e-583f4d89fe8c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:28.795786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:28.798550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bc649-b0c4-4695-a76e-583f4d89fe8c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:28.832474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:28.833088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:28.833360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:28.833628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:28.834253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:28.834595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:28.836143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:28.841503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 438/880] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:28.848169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:28.917285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:28.952805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36bacb-9bf7-4580-8e51-8b5c7f65587f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:28.993515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:28.994179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:28.994459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:28.994727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:28.995391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:28.995691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:28.997063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:29.006934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 443/881] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:29.008630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:29.107477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cd5c-bfb1-4cf6-98b0-d7615694509f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:29.143233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2e431-191a-4188-9ca6-d6ddf9a1cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:29.143846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e431-191a-4188-9ca6-d6ddf9a1cd95 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:29.144122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e431-191a-4188-9ca6-d6ddf9a1cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:29.144393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e431-191a-4188-9ca6-d6ddf9a1cd95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:29.145097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e431-191a-4188-9ca6-d6ddf9a1cd95 None admin] RBAC: Adding query filter params (interface=public, service_id=e343aabb7e0b418f8523a6fc88e29a4f, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:29.145400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e431-191a-4188-9ca6-d6ddf9a1cd95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:29.146776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e431-191a-4188-9ca6-d6ddf9a1cd95 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:29.156708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 439/882] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:17:29 2022] GET /identity/v3/endpoints?service_id=e343aabb7e0b418f8523a6fc88e29a4f&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:29.158201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:29.261487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047704bc-c0e0-4768-86e6-425f5820d5a7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:29.291496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:29.297141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11993-76a7-4a4e-9e08-8ef88f6f9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:29.297804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11993-76a7-4a4e-9e08-8ef88f6f9c2b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:29.298136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11993-76a7-4a4e-9e08-8ef88f6f9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:29.298416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11993-76a7-4a4e-9e08-8ef88f6f9c2b None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:29.299104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e11993-76a7-4a4e-9e08-8ef88f6f9c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:29.300472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e11993-76a7-4a4e-9e08-8ef88f6f9c2b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:29.310983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 444/883] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:29 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:17:29.631667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029320c3-76e9-4cf1-86c2-e14e1334ab9a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:29.631955 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029320c3-76e9-4cf1-86c2-e14e1334ab9a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:29.632230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029320c3-76e9-4cf1-86c2-e14e1334ab9a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:29.633813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 440/884] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:29.639337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b0ca-1436-48d8-a282-d812c11221b8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:29.639791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b0ca-1436-48d8-a282-d812c11221b8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:29.639882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b0ca-1436-48d8-a282-d812c11221b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:29.658711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4550b0ca-1436-48d8-a282-d812c11221b8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:29.659928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4550b0ca-1436-48d8-a282-d812c11221b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:29.729294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 445/885] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:29.863824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17d34d-4d76-491d-882f-10e6163b7b11 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:29.864507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17d34d-4d76-491d-882f-10e6163b7b11 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:29.864507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17d34d-4d76-491d-882f-10e6163b7b11 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:29.865974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 441/886] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:29.871524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4842-6624-430f-8964-f2a462b0f8b5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:29.872053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4842-6624-430f-8964-f2a462b0f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:29.872533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4842-6624-430f-8964-f2a462b0f8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:29.891114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3e2b4842-6624-430f-8964-f2a462b0f8b5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:29.892661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3e2b4842-6624-430f-8964-f2a462b0f8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:29.957928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 446/887] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:30.006743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17d34d-4d76-491d-882f-10e6163b7b11 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.036603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:30.117021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17d34d-4d76-491d-882f-10e6163b7b11 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:30.151440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:30.151996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.152626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.152887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.153474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:30.154854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:30.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:30.164919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:30.165855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 442/888] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:30.173401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b4842-6624-430f-8964-f2a462b0f8b5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.222971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.232384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:30.288032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b4842-6624-430f-8964-f2a462b0f8b5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:30.333583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:30.334619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.335232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.335726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.336570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:30.337077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:30.339440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:30.350599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 447/889] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:30.351842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:30.353695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.362067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32e80-1029-43be-8d79-732aa5820dc9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:30.396743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925b4fb-b7e5-4eda-9d5e-236936416aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:30.397379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b4fb-b7e5-4eda-9d5e-236936416aaf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.397650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b4fb-b7e5-4eda-9d5e-236936416aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.397917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b4fb-b7e5-4eda-9d5e-236936416aaf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.408635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925b4fb-b7e5-4eda-9d5e-236936416aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4925b4fb-b7e5-4eda-9d5e-236936416aaf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:30.413791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:30.414778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:30.415656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 443/890] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:30.416398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6cfda-3e0e-43eb-9ca8-4ed0268f6c31 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.416398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6cfda-3e0e-43eb-9ca8-4ed0268f6c31 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.417073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6cfda-3e0e-43eb-9ca8-4ed0268f6c31 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.418011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 444/891] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:30.420594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6cfda-3e0e-43eb-9ca8-4ed0268f6c31 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.468836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22d95-6cf0-45e8-a243-c361c091e735 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:30.489433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:30.509215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1be5dd-d11e-46c5-b882-8e26489eafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:30.509845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1be5dd-d11e-46c5-b882-8e26489eafb4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.513464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1be5dd-d11e-46c5-b882-8e26489eafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.513776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1be5dd-d11e-46c5-b882-8e26489eafb4 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.514435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1be5dd-d11e-46c5-b882-8e26489eafb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:30.514740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1be5dd-d11e-46c5-b882-8e26489eafb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:30.516225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1be5dd-d11e-46c5-b882-8e26489eafb4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:30.529057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 448/892] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:30.529057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b11c7a-bd67-4608-840d-f17121590e09 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.529057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b11c7a-bd67-4608-840d-f17121590e09 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.529057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b11c7a-bd67-4608-840d-f17121590e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.543838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-02b11c7a-bd67-4608-840d-f17121590e09 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:30.545208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-02b11c7a-bd67-4608-840d-f17121590e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:30.550008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6cfda-3e0e-43eb-9ca8-4ed0268f6c31 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:30.595101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:30.596190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.597033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.597511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.598426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:30.599760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:30.601487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:30.625728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 445/893] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:30.629418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.649034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 449/894] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:30.655699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:30.751970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0ff8c-7d8b-4897-afb5-b59cbbbc942b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:30.788542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:30.789497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.789959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.790399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.800955 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:30.802707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:30.818375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:30.819396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:30.820304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:30.820304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:30.820304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:30.822335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 446/895] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:30.828169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b11c7a-bd67-4608-840d-f17121590e09 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.935477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b11c7a-bd67-4608-840d-f17121590e09 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:30.950148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:30.952107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:30.973776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:30.974397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:30.974671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:30.974972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:30.975925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:30.976229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:30.977604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:30.994901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 450/896] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:30.996547 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.037514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:31.081812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f931030-5ad6-474e-bb48-cc79384329a4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.109991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c731-bd9f-468f-a28c-7783ffbc93ac None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.119711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.120354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.120790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.121201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.122021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.123754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:31.133560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:31.134592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:31.135484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:31.137948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 447/897] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:31.143751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.157427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.158516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.158804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.159118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.167807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.169677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:31.181988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:31.183090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:31.184073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 451/898] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:17:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:31.190844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.246858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:31.272578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3356a1-2b18-42f4-8179-34b18206bc78 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.304239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:31.312361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.313407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.313907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.314693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.315835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:31.316566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.318230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.322386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e76f1-766b-4ab0-8671-08400d32107c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.329981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 448/899] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:31.332422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.360742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.361425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.361698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.361976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.362702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:31.363033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.364536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.390053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 452/900] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:31.391331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.464548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd94df9-0d10-4014-9da0-8e69cb151089 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.507597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:31.510094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120af35-2cdc-44e0-abbf-6970c68c1b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.510978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120af35-2cdc-44e0-abbf-6970c68c1b4c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.510978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120af35-2cdc-44e0-abbf-6970c68c1b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.511272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120af35-2cdc-44e0-abbf-6970c68c1b4c None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.512084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120af35-2cdc-44e0-abbf-6970c68c1b4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:31.512374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120af35-2cdc-44e0-abbf-6970c68c1b4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.514357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120af35-2cdc-44e0-abbf-6970c68c1b4c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.520268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcb5aa-5d9a-4d2b-a197-0a1573b3480d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.520422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 449/901] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:31.521601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01cd9-8dfd-4043-97fd-cc2e4c33cc5a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.521887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01cd9-8dfd-4043-97fd-cc2e4c33cc5a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.522159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01cd9-8dfd-4043-97fd-cc2e4c33cc5a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.526873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 450/902] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:31.526873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01cd9-8dfd-4043-97fd-cc2e4c33cc5a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.558813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.559419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.559690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.560004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.587520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:31.635507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01cd9-8dfd-4043-97fd-cc2e4c33cc5a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.641664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.643579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.669944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40c84-55f1-4c80-8f27-b61a8d446406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.670647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40c84-55f1-4c80-8f27-b61a8d446406 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.670960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40c84-55f1-4c80-8f27-b61a8d446406 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.671233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40c84-55f1-4c80-8f27-b61a8d446406 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.671961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40c84-55f1-4c80-8f27-b61a8d446406 None admin] RBAC: Adding query filter params (interface=public, service_id=9494cec19d1b4193a50bbb49a321684f, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:31.672237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40c84-55f1-4c80-8f27-b61a8d446406 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.673642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40c84-55f1-4c80-8f27-b61a8d446406 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.678543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 451/903] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/endpoints?service_id=9494cec19d1b4193a50bbb49a321684f&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:31.679782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaffb86-0f9a-4ee0-8304-79754956664d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.680066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaffb86-0f9a-4ee0-8304-79754956664d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.680336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaffb86-0f9a-4ee0-8304-79754956664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.698346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8aaffb86-0f9a-4ee0-8304-79754956664d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:31.699531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8aaffb86-0f9a-4ee0-8304-79754956664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:31.746054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:31.758114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 453/904] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 07:17:31.758898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.770410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 452/905] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:31.771308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaffb86-0f9a-4ee0-8304-79754956664d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:31.827586 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:31.883501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b69f6d-588e-41ca-b520-eac60d362e34 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.884085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaffb86-0f9a-4ee0-8304-79754956664d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:31.917732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.918336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.918608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.918944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.919581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.920937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.934877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 454/906] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:17:31.935079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:31.935079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:31.935079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:31.935079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:31.945171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:31.946793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:31.963499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:31.964985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:31.965882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:31.965882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:31.965882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:31.965882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 453/907] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:31.970645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.031303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:32.043942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.085911 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a91ef-0209-4282-b812-609fd55dd9a2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.136130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.136749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.137029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.137595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.138246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:32.138539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.139941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.155902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 455/908] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:32.162464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.171676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec84bf-bc97-4cf5-a836-c4849e6193ea None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.174075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:32.213694 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.214336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.214611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.214925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.215517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.216968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:32.226496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:32.227508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:32.228387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 454/909] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Sep 15 07:17:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:32.235654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.292467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb772-14d5-429c-aa79-4b2a476f4e5e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.312448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:32.333084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.334097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.334563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.335062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.342319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.344076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:32.356964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:32.357934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:32.359277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:32.360774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596e29f-3e50-46d3-b06f-11a108fd9ff0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.361672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 456/910] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:32.367904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.413727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.415246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.415966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.416449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.417484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:32.417954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.420225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.431641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 455/911] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:32.432982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.467217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:32.490155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eba08c-a3f4-49e0-95ec-67a14a530562 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.533441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.534444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.534978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.535446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.536358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:32.537015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.539313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.547496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c77ae2-6d2c-4cd4-bbe0-5f53949af436 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.554073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 457/912] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:32.559636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.589506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.590524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.591025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.591506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.592387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:32.592894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.594599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.606588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 456/913] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:32.608022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:32.609996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:32.689429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18faf1-0d56-4cfa-b07d-a07b6568c141 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.710751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:32.716609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb912f0-b30e-4fc2-b2bf-c8692862ed28 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:32.729151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350844a-cfeb-473c-bae3-e71539566e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.729774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350844a-cfeb-473c-bae3-e71539566e2f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.730053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350844a-cfeb-473c-bae3-e71539566e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.730325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350844a-cfeb-473c-bae3-e71539566e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.731189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350844a-cfeb-473c-bae3-e71539566e2f None admin] RBAC: Adding query filter params (role.id=087bd9c4b31945639ba722e6844ed7f6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:32.731499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350844a-cfeb-473c-bae3-e71539566e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.733038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350844a-cfeb-473c-bae3-e71539566e2f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.739257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 458/914] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:32 2022] GET /identity/v3/role_assignments?user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=087bd9c4b31945639ba722e6844ed7f6 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:32.740453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af53c3-fca4-4bd5-97f3-1444d16f7502 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.740735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af53c3-fca4-4bd5-97f3-1444d16f7502 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.741007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af53c3-fca4-4bd5-97f3-1444d16f7502 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.742449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 459/915] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:32.753502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6f55b-c77c-44c8-9283-20670be89bc9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.754870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6f55b-c77c-44c8-9283-20670be89bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.755168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6f55b-c77c-44c8-9283-20670be89bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.759069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:32.760041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:32.760509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:32.760992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:32.761919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:32.763604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:32.777310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1bb6f55b-c77c-44c8-9283-20670be89bc9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:32.778984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1bb6f55b-c77c-44c8-9283-20670be89bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:32.794851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 457/916] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:32.879929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 460/917] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:33.150353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:33.259165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80908-9ccb-4c53-8473-e4beb43c4d0d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:33.293168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6de8d-8701-4bfb-b8d2-79e0975ff98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:33.293786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6de8d-8701-4bfb-b8d2-79e0975ff98d None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:33.294061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6de8d-8701-4bfb-b8d2-79e0975ff98d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:33.294330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6de8d-8701-4bfb-b8d2-79e0975ff98d None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:33.295023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6de8d-8701-4bfb-b8d2-79e0975ff98d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:33.296411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6de8d-8701-4bfb-b8d2-79e0975ff98d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:33.319273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 458/918] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:33 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:34.219528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3513d-e45f-448e-99c2-5d7fbb5aa8a2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:34.220617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3513d-e45f-448e-99c2-5d7fbb5aa8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:34.221099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3513d-e45f-448e-99c2-5d7fbb5aa8a2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:34.223459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 461/919] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:34.229664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7b723-f6f7-462c-809d-bfcc9a8d48f6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:34.230637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7b723-f6f7-462c-809d-bfcc9a8d48f6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:34.231146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7b723-f6f7-462c-809d-bfcc9a8d48f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:34.250251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bab7b723-f6f7-462c-809d-bfcc9a8d48f6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:34.251898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bab7b723-f6f7-462c-809d-bfcc9a8d48f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:34.259591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:34.333345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 459/920] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:34.595894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3513d-e45f-448e-99c2-5d7fbb5aa8a2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:34.632611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:34.707867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3513d-e45f-448e-99c2-5d7fbb5aa8a2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:34.742014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:34.742702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:34.743007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:34.743276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:34.743860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:34.745217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:34.754123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:34.755148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:34.755985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 462/921] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:34.761463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7b723-f6f7-462c-809d-bfcc9a8d48f6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:34.862862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7b723-f6f7-462c-809d-bfcc9a8d48f6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:34.905091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff17c2-dffd-443d-98b1-54964c7d8209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:34.905729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff17c2-dffd-443d-98b1-54964c7d8209 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:34.906005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff17c2-dffd-443d-98b1-54964c7d8209 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:34.906273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff17c2-dffd-443d-98b1-54964c7d8209 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:34.906975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff17c2-dffd-443d-98b1-54964c7d8209 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:34.907274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff17c2-dffd-443d-98b1-54964c7d8209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:34.908734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff17c2-dffd-443d-98b1-54964c7d8209 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:34.914639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 460/922] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:34.920425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.000103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940a35-7e55-49e6-a444-a08905342626 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.000442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940a35-7e55-49e6-a444-a08905342626 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.000940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940a35-7e55-49e6-a444-a08905342626 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.002565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 461/923] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:35.003865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867566-f754-45a5-a5de-f05392685bc3 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.004347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867566-f754-45a5-a5de-f05392685bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.004808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867566-f754-45a5-a5de-f05392685bc3 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.006417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 462/924] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:35.007739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634bce4-210c-4747-b1a7-a59d62ba6664 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.008233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634bce4-210c-4747-b1a7-a59d62ba6664 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.008704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634bce4-210c-4747-b1a7-a59d62ba6664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.014859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:35.015535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:35.025399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a27c7-dc06-4bb4-bd84-cb2f7dc24dc7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:35.027725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a634bce4-210c-4747-b1a7-a59d62ba6664 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:35.028920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a634bce4-210c-4747-b1a7-a59d62ba6664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:35.063431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cc82d-3bf3-4da7-a1e9-6c6f5954f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:35.064124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc82d-3bf3-4da7-a1e9-6c6f5954f386 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.064348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc82d-3bf3-4da7-a1e9-6c6f5954f386 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.064611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc82d-3bf3-4da7-a1e9-6c6f5954f386 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.065224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cc82d-3bf3-4da7-a1e9-6c6f5954f386 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:35.066108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cc82d-3bf3-4da7-a1e9-6c6f5954f386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:35.066892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cc82d-3bf3-4da7-a1e9-6c6f5954f386 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:35.076353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 463/925] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 15 07:17:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:35.076353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3381-e2c3-4640-bd9e-e563f9e3f23a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.076353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3381-e2c3-4640-bd9e-e563f9e3f23a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.076353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3381-e2c3-4640-bd9e-e563f9e3f23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.093137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b75b3381-e2c3-4640-bd9e-e563f9e3f23a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:35.094304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b75b3381-e2c3-4640-bd9e-e563f9e3f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:35.103457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 463/926] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:35.104190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634bce4-210c-4747-b1a7-a59d62ba6664 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.191853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 464/927] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:35.208894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634bce4-210c-4747-b1a7-a59d62ba6664 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:35.239959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:35.245350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:35.245966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.246246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.246512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.247266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:35.248754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:35.272484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 464/928] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:35.378922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3381-e2c3-4640-bd9e-e563f9e3f23a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.460245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.477795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:35.496262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3381-e2c3-4640-bd9e-e563f9e3f23a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:35.545039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec296eda-f06c-461a-908b-defa4fe635cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:35.545789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296eda-f06c-461a-908b-defa4fe635cb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.546065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296eda-f06c-461a-908b-defa4fe635cb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.546446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296eda-f06c-461a-908b-defa4fe635cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.564249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec296eda-f06c-461a-908b-defa4fe635cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ec296eda-f06c-461a-908b-defa4fe635cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:35.569845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:35.570851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:35.571749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:35.572398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 465/929] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 15 07:17:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:35.574266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107e55e-8d91-49bc-8fa2-bf56496e0967 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.574716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107e55e-8d91-49bc-8fa2-bf56496e0967 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.575397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107e55e-8d91-49bc-8fa2-bf56496e0967 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.576946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 466/930] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:35.578304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107e55e-8d91-49bc-8fa2-bf56496e0967 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.583701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32c77-c641-47c0-96c4-21bde41682da None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:35.627512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9cbf-a343-44a6-8ea4-cb0036f631b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:35.628195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9cbf-a343-44a6-8ea4-cb0036f631b1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.628551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9cbf-a343-44a6-8ea4-cb0036f631b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.628820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9cbf-a343-44a6-8ea4-cb0036f631b1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.629420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f9cbf-a343-44a6-8ea4-cb0036f631b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:35.630794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f9cbf-a343-44a6-8ea4-cb0036f631b1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5c2f9cbf-a343-44a6-8ea4-cb0036f631b1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:35.640565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:35.641562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:35.647696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 465/931] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:35.648658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac3031-151a-4f9f-b06f-4780fef8f135 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.648658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac3031-151a-4f9f-b06f-4780fef8f135 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.648658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac3031-151a-4f9f-b06f-4780fef8f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.664195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-eaac3031-151a-4f9f-b06f-4780fef8f135 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:35.665381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-eaac3031-151a-4f9f-b06f-4780fef8f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:35.694412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107e55e-8d91-49bc-8fa2-bf56496e0967 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:35.715017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:35.728885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:35.729508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.729785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.730055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.730722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:35.731054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:35.732433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:35.742999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 466/932] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:35.742999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac3031-151a-4f9f-b06f-4780fef8f135 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.750729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 467/933] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 15 07:17:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:35.752378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.757427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:35.865035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7fd88-d378-452b-9a68-3e6aeac44575 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:35.874060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac3031-151a-4f9f-b06f-4780fef8f135 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:35.904838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:35.905475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.905746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.906008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.917887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:35.919546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:35.922990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:35.923974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:35.924462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:35.924930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:35.925760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:35.926734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:35.928843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:35.934748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 467/934] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:35.935120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:35.936042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:35.936923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:35.936923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:35.936923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:35.936923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 468/935] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:35.943711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.943844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:35.999759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.005958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.055136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3a45e-4cc4-4804-9d57-4fc6ebd3f592 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.067024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9f2b9-9098-4cd6-86a7-27baa2ed5805 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.089188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.089852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.090129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.090394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.091172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:36.091476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.092883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.103871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.104507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.104780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.105057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.105678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:36.105977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.107392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.107725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 469/936] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:36.108687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.116692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 468/937] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:36.117793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.242757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a993a-0c4f-4d87-8d5e-6f9daa92806d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.257128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a29fec-1bb2-4a35-8346-53f8a12bbe9a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.260970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.275846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.287347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.288463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.288974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.289449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.290253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.291913 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:36.301757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:36.302846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:36.303729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:36.307373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 470/938] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:36.310147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.314542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.315381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.315697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.315963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.328147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.330052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:36.345397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:36.346721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:36.347744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:36.350272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 469/939] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:36.360153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.442920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cd0d4-f261-4fb2-81ae-29f371dd09c5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.474298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567fc8-651a-4855-beb4-6b3978ba7360 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.478508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.479159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.479443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.479716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.480345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:36.480646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.482024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.490943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 471/940] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:36.493485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.510921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.511469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.511743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.512014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.512904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:36.513207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.514752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.538599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 470/941] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:36.539107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.540381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.574385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.601311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3db85-4164-418e-8cb6-c66b8e6fd4a3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.643639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.644367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.644714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.645286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.646456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:36.647142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.648981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.653110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf416c-565a-4d15-b55c-b72428307528 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.662801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 472/942] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:36.664291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.703995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.705247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.705529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.705805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.718592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.720972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:36.740471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:36.741756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:36.743953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:36.743953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:36.743953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:36.743953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 471/943] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:36.747350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.784137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34846f-f469-4314-bd01-9696f7b98db7 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.792560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.823265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.824294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.824840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.825303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.826203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] RBAC: Adding query filter params (interface=public, service_id=ad0ca9cf54a9465487f1e550f89a1c2c, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:36.826714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.828516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.834501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 473/944] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/endpoints?service_id=ad0ca9cf54a9465487f1e550f89a1c2c&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:36.840218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.847460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:36.872343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73111b9-2fd6-4e2b-b3d0-74efcd61adac None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:36.918147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:36.918946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:36.919340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:36.919633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:36.920400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:36.920707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:36.922203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:36.943933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 472/945] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:36.946511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:36.978207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b5ff-5fdf-45b4-a3ab-6b86748c75fd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:37.013378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:37.013835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:37.014161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:37.014433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:37.015150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:37.016523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:37.031043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 474/946] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:17:37.065461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64624e3c-59bb-4cb2-b407-d6e2a771871a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:37.108357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:37.109439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:37.109914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:37.110396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:37.118888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:37.120768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:37.124173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:37.135263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:37.136231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:37.137140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:37.139692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 473/947] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:37.148003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:37.192193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:37.262723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60746254-ceea-40e4-933b-2d7178d950dd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:37.299456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bb92e-906f-4b7f-9f52-b5107e2e262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:37.300073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb92e-906f-4b7f-9f52-b5107e2e262b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:37.300352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb92e-906f-4b7f-9f52-b5107e2e262b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:37.300622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb92e-906f-4b7f-9f52-b5107e2e262b None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:37.301315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bb92e-906f-4b7f-9f52-b5107e2e262b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:37.301615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bb92e-906f-4b7f-9f52-b5107e2e262b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:37.303069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bb92e-906f-4b7f-9f52-b5107e2e262b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:37.316809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 475/948] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:37.322970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:37.432289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85b07-cfcb-4721-9bba-4ce2bafbc263 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:37.468826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bb006-6102-4bf5-b08c-905c208aea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:37.469895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bb006-6102-4bf5-b08c-905c208aea4d None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:37.470436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bb006-6102-4bf5-b08c-905c208aea4d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:37.470928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bb006-6102-4bf5-b08c-905c208aea4d None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/77673f0ca55f4eeb9fbee6d9c48dc4e6/roles/087bd9c4b31945639ba722e6844ed7f6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:37.473672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bb006-6102-4bf5-b08c-905c208aea4d None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=77673f0ca55f4eeb9fbee6d9c48dc4e6, role_id=087bd9c4b31945639ba722e6844ed7f6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:37.475376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bb006-6102-4bf5-b08c-905c208aea4d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:37.493492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 474/949] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:17:37 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/77673f0ca55f4eeb9fbee6d9c48dc4e6/roles/087bd9c4b31945639ba722e6844ed7f6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:17:37.529742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94eccbd-b423-4513-9cd3-68a515a75814 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:37.530271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94eccbd-b423-4513-9cd3-68a515a75814 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:37.530271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94eccbd-b423-4513-9cd3-68a515a75814 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:37.531934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 476/950] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:37.537891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363e6f-32ac-4755-b303-86e0346b3dcb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:37.538179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363e6f-32ac-4755-b303-86e0346b3dcb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:37.538435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363e6f-32ac-4755-b303-86e0346b3dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:37.557744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a5363e6f-32ac-4755-b303-86e0346b3dcb None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:37.558991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5363e6f-32ac-4755-b303-86e0346b3dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:37.631304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:37.646402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 475/951] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:37.905427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94eccbd-b423-4513-9cd3-68a515a75814 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:38.009397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:38.017210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94eccbd-b423-4513-9cd3-68a515a75814 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:38.053674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:38.054297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:38.054573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:38.054860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:38.055535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:38.056979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:38.059614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING keystone.server.flask.common [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 07:17:38.078793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.sql.core [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 07:17:38.078793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 07:17:38.078793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [parameters: {'id': '4e7acc6fad444bc49284258905669609', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 07:17:38.078793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81430) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e7acc6fad444bc49284258905669609.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e7acc6fad444bc49284258905669609. Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 07:17:38.086723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 15 07:17:38.087573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application yield resource Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise self.value Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application session.commit() Sep 15 07:17:38.088768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.flush() Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application compat.raise_( Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 07:17:38.090215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 07:17:38.091351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 07:17:38.092358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [parameters: {'id': '4e7acc6fad444bc49284258905669609', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:38.093716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:38.094720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e7acc6fad444bc49284258905669609. Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:38.095924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 477/952] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Sep 15 07:17:37 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:38.098041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363e6f-32ac-4755-b303-86e0346b3dcb None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:38.207140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363e6f-32ac-4755-b303-86e0346b3dcb None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:38.243922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e3666-7f27-412c-bdb2-1c153b9b1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:38.244568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3666-7f27-412c-bdb2-1c153b9b1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:38.244841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3666-7f27-412c-bdb2-1c153b9b1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:38.245106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3666-7f27-412c-bdb2-1c153b9b1ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:38.252579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e3666-7f27-412c-bdb2-1c153b9b1ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:38.254040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e3666-7f27-412c-bdb2-1c153b9b1ce0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-878e3666-7f27-412c-bdb2-1c153b9b1ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:38.265760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:38.266717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:38.267785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 476/953] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:38.274978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:38.392945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efc95d-7f49-43de-b088-d9c184129b04 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:38.428279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6c94-163b-4a96-9193-61f17c5aef40 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:38.428804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6c94-163b-4a96-9193-61f17c5aef40 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:38.428918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6c94-163b-4a96-9193-61f17c5aef40 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:38.430326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 477/954] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:17:38.435492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495fd0-d84a-4cb0-ada2-94bc4210b70c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:38.435771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495fd0-d84a-4cb0-ada2-94bc4210b70c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:38.436103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495fd0-d84a-4cb0-ada2-94bc4210b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:38.436223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:38.437051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:38.437523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:38.437988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:38.439068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:38.439670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:38.441716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:38.456095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-da495fd0-d84a-4cb0-ada2-94bc4210b70c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:38.457430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-da495fd0-d84a-4cb0-ada2-94bc4210b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:38.466193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 478/955] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:38.512947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:38.538602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 478/956] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:38.806872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:38.819915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:38.913296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b522-10d6-44a6-b58f-296156666884 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:38.952608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b75289-78ae-4c2f-9667-7e24efbde284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:38.953580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b75289-78ae-4c2f-9667-7e24efbde284 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:38.954057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b75289-78ae-4c2f-9667-7e24efbde284 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:38.954591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b75289-78ae-4c2f-9667-7e24efbde284 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:38.955466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b75289-78ae-4c2f-9667-7e24efbde284 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:38.957077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b75289-78ae-4c2f-9667-7e24efbde284 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:38.974911 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 479/957] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:38 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:39.374102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072855-488b-4885-8580-16aeeebfd4c6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:39.374869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072855-488b-4885-8580-16aeeebfd4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:39.375346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072855-488b-4885-8580-16aeeebfd4c6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:39.377432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 479/958] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:39.383638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e99aef-34eb-4605-8c5e-02c2d9157028 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:39.384264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e99aef-34eb-4605-8c5e-02c2d9157028 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:39.384726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e99aef-34eb-4605-8c5e-02c2d9157028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:39.405453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d0e99aef-34eb-4605-8c5e-02c2d9157028 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:39.407394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d0e99aef-34eb-4605-8c5e-02c2d9157028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:39.474520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:39.490341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 480/959] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:39.718787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449c6a-8076-4ace-92b0-e974f87f25db None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:39.719358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449c6a-8076-4ace-92b0-e974f87f25db None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:39.719358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449c6a-8076-4ace-92b0-e974f87f25db None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:39.720999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 480/960] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:39.727222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffce43-d741-4853-b294-b1d96c16c1a4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:39.727502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffce43-d741-4853-b294-b1d96c16c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:39.727768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffce43-d741-4853-b294-b1d96c16c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:39.746781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-21ffce43-d741-4853-b294-b1d96c16c1a4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:39.748055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-21ffce43-d741-4853-b294-b1d96c16c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:39.781421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449c6a-8076-4ace-92b0-e974f87f25db None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:39.819868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 481/961] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:39.911693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449c6a-8076-4ace-92b0-e974f87f25db None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:39.958293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:39.958961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:39.959447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:39.959718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:39.960309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:39.961693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:39.972166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:39.973279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:39.974288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 481/962] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:39.981914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffce43-d741-4853-b294-b1d96c16c1a4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:40.080489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffce43-d741-4853-b294-b1d96c16c1a4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:40.106980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:40.114065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:40.116679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:40.117295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.117574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.117842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.118475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:40.118773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:40.120188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:40.130159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 482/963] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:40.131521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:40.171178 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:40.235815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ed715-52eb-4f09-8e48-fa76236021be None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:40.239938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f515d5-33f0-4654-9ce0-0d6a8290dea2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:40.270897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:40.271873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.272342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.272909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.273849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:40.274363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:40.276017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:40.286444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 483/964] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:40.286606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:40.286606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.286606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.286606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.288217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:40.303977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:40.313181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:40.314231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:40.315154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:40.318904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 482/965] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 15 07:17:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:40.322708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:40.359139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:40.408634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771b9d-12fb-474a-bac7-78671b557ce1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:40.445422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:40.446370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.446783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.447335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.448133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:40.449649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:40.466010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daac6c-dc8d-47cf-8806-395cf58a6eaa None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:40.469118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:40.475595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 484/966] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:17:40.527986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5973be-f9d2-49cb-ad08-f25c91426382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:40.528929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5973be-f9d2-49cb-ad08-f25c91426382 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.529434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5973be-f9d2-49cb-ad08-f25c91426382 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.529868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5973be-f9d2-49cb-ad08-f25c91426382 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.530795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5973be-f9d2-49cb-ad08-f25c91426382 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:40.531266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5973be-f9d2-49cb-ad08-f25c91426382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:40.532966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5973be-f9d2-49cb-ad08-f25c91426382 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:40.544518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 483/967] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 15 07:17:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:40.552679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:40.669712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78f3f9-b3c0-4798-8b85-4ceff2d2e0be None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:40.682101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:40.683856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c300f-bc6f-46d0-8f34-f44123f6e354 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.684163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c300f-bc6f-46d0-8f34-f44123f6e354 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.684433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c300f-bc6f-46d0-8f34-f44123f6e354 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.686255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 484/968] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:40.692828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134ab5-59a2-4d32-b99a-c2ba4fdeeedb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.693403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134ab5-59a2-4d32-b99a-c2ba4fdeeedb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.693898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134ab5-59a2-4d32-b99a-c2ba4fdeeedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.713462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:40.714032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.714307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.714575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.716323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-68134ab5-59a2-4d32-b99a-c2ba4fdeeedb None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:40.717795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-68134ab5-59a2-4d32-b99a-c2ba4fdeeedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:40.726745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:40.728279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:40.748302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:40.749343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:40.750243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:40.750243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:40.750243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:40.750243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 485/969] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:40.755832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:40.797931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 485/970] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:40.865919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab551-2a59-4e6e-b218-553869505472 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:40.900892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:40.901549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:40.901827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:40.902098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:40.902759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:40.903087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:40.904682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:40.921375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 486/971] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:40.924018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134ab5-59a2-4d32-b99a-c2ba4fdeeedb None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.020445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.029605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134ab5-59a2-4d32-b99a-c2ba4fdeeedb None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.065330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.065981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.066255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.066519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.074921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.076405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.083276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:41.089219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:41.090270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:41.095922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 486/972] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:17:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:41.097918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.139241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.204074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124b594-ab5e-4444-a249-46461e2d0acf None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.209333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3d50-330f-424e-8c37-04900eac3a9e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.239338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.240034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.240215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.240487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.241126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.242546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.245869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.246788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.247286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.247764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.248736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:41.249231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.250869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.257602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.sql.core [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 07:17:41.257602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 07:17:41.257602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [parameters: {'user_id': '11cf3d33e02a4aa1a6ebe57aed4d3806', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 07:17:41.257602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81430) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-49d1ecde-f479-4b1b-88c9-a9ddcdb418de None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 15 07:17:41.265034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 07:17:41.265973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application yield resource Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application next(self.gen) Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise self.value Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application session.commit() Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 07:17:41.267050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.session.flush() Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application compat.raise_( Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 07:17:41.267965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 07:17:41.268864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application conn.query(q) Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application result.read() Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 07:17:41.269703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [parameters: {'user_id': '11cf3d33e02a4aa1a6ebe57aed4d3806', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:41.270574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 15 07:17:41.273294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 487/973] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 15 07:17:41 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01807965-f293-4e5f-be09-77680ba686c0 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01807965-f293-4e5f-be09-77680ba686c0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.275399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01807965-f293-4e5f-be09-77680ba686c0 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.276674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 487/974] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:41.276815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 488/975] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:41.276963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.278230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fb5e3-3656-4ad2-96f1-ef32f37826e2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.278581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fb5e3-3656-4ad2-96f1-ef32f37826e2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.278875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fb5e3-3656-4ad2-96f1-ef32f37826e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.290605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.297463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-902fb5e3-3656-4ad2-96f1-ef32f37826e2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:41.299037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-902fb5e3-3656-4ad2-96f1-ef32f37826e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:41.365051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 489/976] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:41.365891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fb5e3-3656-4ad2-96f1-ef32f37826e2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.385420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179169-81e4-4739-bbfd-194efb7d4ff5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.391330 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.435220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.437043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.439200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.439476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.512838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fb5e3-3656-4ad2-96f1-ef32f37826e2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.517608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.519323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.531001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.561747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.562388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.562658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.562945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.571329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.572981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:41.586281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:41.587265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 07:17:41.588216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.592306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 490/977] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:41.593134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.631296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 488/978] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:41.638000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.681975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.708251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e35a7-4bb3-4d13-84b9-89e2289c5997 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.742769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a71e0-4d35-4ad8-a905-7ce53b469421 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.749717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.750329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.750600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.750899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.751632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:41.751927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.753366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.756804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.780557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.781253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.781470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.781739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.790291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 491/979] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:41.791110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.798479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.801434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:41.828131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:41.829926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:41.831557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:41.831557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:41.831557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:41.834784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 489/980] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:41.839921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:41.929440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d932ad-7013-4d2b-b666-5c719a94302c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.963612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:41.969919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:41.971819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:41.972301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:41.972441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed92203-6d12-410a-9f10-dd4ebe062524 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:41.972908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:41.973517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:41.974946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:41.985989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:41.987139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:41.988133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:41.992941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 492/981] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:41.993817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:42.021279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.021902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.022173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.022439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.023643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:42.023643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.026624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.042980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 490/982] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:42.049132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:42.079650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:42.127020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dfb1c-3359-43f7-a201-9abdef494ba4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:42.162358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.163006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.163283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.163549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.164176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:42.164474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.165828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.168535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23163bc6-d157-417e-bae5-a90153427a45 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:42.175422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 493/983] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:42.176517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:42.210331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.211006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.211284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.211583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.218485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.220005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:42.231561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:42.232470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:42.233404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 491/984] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:42.238590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:42.240716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:42.282648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83d41-c953-41e9-b43e-74fcb352f8d9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:42.319642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.320298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:42.320590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.320858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.321262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.322036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:42.322339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.323740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.328923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 494/985] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:42.335104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:42.345348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7d87e-c86b-44de-b90c-ee430a0d0f7d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:42.381921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.382772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.383228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.383627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.384451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:42.384983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.386558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.398549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 492/986] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:42.404330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:42.443761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6704-8eeb-49aa-8f8e-918d5b5b8764 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:42.467958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:42.480983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.481596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.481871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.482136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.482848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] RBAC: Adding query filter params (interface=public, service_id=38574e6bd30e438c8d3ea8ef2c130d98, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:42.483152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.484644 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.495594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 495/987] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:17:42 2022] GET /identity/v3/endpoints?service_id=38574e6bd30e438c8d3ea8ef2c130d98&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:42.496474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:42.512130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a3a54-6b1d-4740-85b3-604d68f712c3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:42.545924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7f818-4d60-4ab8-8390-02e8b0f4d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.546531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f818-4d60-4ab8-8390-02e8b0f4d895 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.546811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f818-4d60-4ab8-8390-02e8b0f4d895 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.547122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f818-4d60-4ab8-8390-02e8b0f4d895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.547844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f818-4d60-4ab8-8390-02e8b0f4d895 None admin] RBAC: Adding query filter params (role.id=087bd9c4b31945639ba722e6844ed7f6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:42.548204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f818-4d60-4ab8-8390-02e8b0f4d895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.549766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f818-4d60-4ab8-8390-02e8b0f4d895 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.555542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 493/988] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:42 2022] GET /identity/v3/role_assignments?user.id=77673f0ca55f4eeb9fbee6d9c48dc4e6&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=087bd9c4b31945639ba722e6844ed7f6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:42.616092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeb025-767d-47db-bf69-94f40dd406c3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:42.657764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe788a90-7ece-4dc1-a476-2e9a5910e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:42.658422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe788a90-7ece-4dc1-a476-2e9a5910e70f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.658695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe788a90-7ece-4dc1-a476-2e9a5910e70f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.659021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe788a90-7ece-4dc1-a476-2e9a5910e70f None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.659675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe788a90-7ece-4dc1-a476-2e9a5910e70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:42.661151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe788a90-7ece-4dc1-a476-2e9a5910e70f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:42.668909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 496/989] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:42 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:17:42.777837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755415ad-e8ce-4319-a417-8b25b1658b44 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.778189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755415ad-e8ce-4319-a417-8b25b1658b44 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.778377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755415ad-e8ce-4319-a417-8b25b1658b44 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.779794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 494/990] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:42.785657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22255-d273-4aeb-8841-fe00880dc364 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:42.785947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22255-d273-4aeb-8841-fe00880dc364 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:42.786202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22255-d273-4aeb-8841-fe00880dc364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:42.806893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4bb22255-d273-4aeb-8841-fe00880dc364 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:42.808124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4bb22255-d273-4aeb-8841-fe00880dc364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:42.860706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:42.886960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 497/991] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:43.153335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755415ad-e8ce-4319-a417-8b25b1658b44 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:43.163115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:43.265039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755415ad-e8ce-4319-a417-8b25b1658b44 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:43.299440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:43.300074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:43.300348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:43.300610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:43.301185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:43.302559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:43.311400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:43.312411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:43.313264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 495/992] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:43.318643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22255-d273-4aeb-8841-fe00880dc364 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:43.422091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22255-d273-4aeb-8841-fe00880dc364 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:43.458000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:43.458606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:43.458877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:43.459212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:43.459842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:43.460138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:43.461592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:43.467753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 498/993] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:43.473761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:43.551102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:43.584664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea5a7-7bad-419b-b829-4e9c8a2b05f6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:43.627965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:43.628612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:43.628882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:43.629152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:43.629788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:43.630090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:43.631528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:43.642044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 496/994] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:43.643744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:43.691960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:43.745640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9616cd5-c357-477a-8cf3-c71b8b355688 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:43.779281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebd8e3-c11a-4876-a685-fc366a6a851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:43.779898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd8e3-c11a-4876-a685-fc366a6a851d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:43.780169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd8e3-c11a-4876-a685-fc366a6a851d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:43.780440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd8e3-c11a-4876-a685-fc366a6a851d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:43.781144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebd8e3-c11a-4876-a685-fc366a6a851d None admin] RBAC: Adding query filter params (interface=admin, service_id=ad0ca9cf54a9465487f1e550f89a1c2c, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:43.781445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebd8e3-c11a-4876-a685-fc366a6a851d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:43.782862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebd8e3-c11a-4876-a685-fc366a6a851d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:43.788153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 499/995] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Sep 15 07:17:43 2022] GET /identity/v3/endpoints?service_id=ad0ca9cf54a9465487f1e550f89a1c2c&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:43.793926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:43.898640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f39aa-917f-445d-8f5f-3097bd5666cc None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:43.936387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed13b0f-139c-4cd0-a974-74853c6f0d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:43.937000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13b0f-139c-4cd0-a974-74853c6f0d63 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:43.937276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13b0f-139c-4cd0-a974-74853c6f0d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:43.937543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13b0f-139c-4cd0-a974-74853c6f0d63 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:43.938147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed13b0f-139c-4cd0-a974-74853c6f0d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:43.939574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed13b0f-139c-4cd0-a974-74853c6f0d63 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:43.940784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:43.946605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 497/996] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:43 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:17:44.744835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9ead-cfc9-4904-8a76-34f76e1ff62c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:44.745408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9ead-cfc9-4904-8a76-34f76e1ff62c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:44.745408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9ead-cfc9-4904-8a76-34f76e1ff62c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:44.746929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 500/997] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:44.752028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a5d41-db74-479b-a67e-1bba77380255 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:44.752441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a5d41-db74-479b-a67e-1bba77380255 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:44.752539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a5d41-db74-479b-a67e-1bba77380255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:44.771251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-512a5d41-db74-479b-a67e-1bba77380255 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:44.772462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-512a5d41-db74-479b-a67e-1bba77380255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:44.849509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 498/998] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:44.905456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b619-52d6-4ed6-a6f3-78c4f79a4e5e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:44.905656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b619-52d6-4ed6-a6f3-78c4f79a4e5e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:44.905871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b619-52d6-4ed6-a6f3-78c4f79a4e5e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:44.907474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 501/999] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:44.912534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48923d23-e677-4ff9-9c49-8d8b155448fa None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:44.912822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48923d23-e677-4ff9-9c49-8d8b155448fa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:44.913097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48923d23-e677-4ff9-9c49-8d8b155448fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:44.931941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-48923d23-e677-4ff9-9c49-8d8b155448fa None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:44.933124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-48923d23-e677-4ff9-9c49-8d8b155448fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:45.000525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 499/1000] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:45.110013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74b619-52d6-4ed6-a6f3-78c4f79a4e5e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:45.208117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74b619-52d6-4ed6-a6f3-78c4f79a4e5e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:45.218512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:45.245135 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:45.245776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:45.246055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:45.246328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] PATH_INFO: `/v3/services/image` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:45.246983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:45.248365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:45.257329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:45.258380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:45.263743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 502/1001] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Sep 15 07:17:45 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:45.264614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48923d23-e677-4ff9-9c49-8d8b155448fa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:45.279161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:45.323895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:45.365545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48923d23-e677-4ff9-9c49-8d8b155448fa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:45.390523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de277996-7793-4b2c-866a-a32b7f575eea None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:45.398296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:45.398937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:45.399212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:45.399480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:45.400102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:45.400400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:45.401769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:45.406449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 500/1002] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:45.411990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:45.428041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:45.429227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:45.429981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:45.430466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:45.431275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:45.433375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:45.443557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:45.444584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 07:17:45.445437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:45.447820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 503/1003] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:45.453411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:45.494906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:45.516662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72d545-1c30-4c28-a5d9-0d5a843785c8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:45.540300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:45.554394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:45.555053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:45.555330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:45.555600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:45.556238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] RBAC: Adding query filter params (type=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:45.556538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:45.557975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:45.559692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5572f6-5ca3-44b3-a57e-b47f64ea69f2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:45.574866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 501/1004] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:45.598597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:45.599261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:45.599534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:45.599800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:45.600451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:45.600755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:45.602168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:45.608266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 504/1005] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:45.614230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:45.733321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b591-903e-4050-9888-fe033dd5903b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:45.769483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53481-aa18-46f0-ae69-d42639b93f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:45.770928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53481-aa18-46f0-ae69-d42639b93f9c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:45.771432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53481-aa18-46f0-ae69-d42639b93f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:45.771895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53481-aa18-46f0-ae69-d42639b93f9c None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:45.772724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc53481-aa18-46f0-ae69-d42639b93f9c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:45.773235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc53481-aa18-46f0-ae69-d42639b93f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:45.774833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc53481-aa18-46f0-ae69-d42639b93f9c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:45.780658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 502/1006] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 15 07:17:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:45.786359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:45.886580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fd1fc-69cc-4df2-8eb2-8fdd49843848 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:45.888147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:45.921984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf5913-f4dc-4bc3-b367-b7fb7fa911fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:45.922596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf5913-f4dc-4bc3-b367-b7fb7fa911fe None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:45.922870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf5913-f4dc-4bc3-b367-b7fb7fa911fe None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:45.923198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf5913-f4dc-4bc3-b367-b7fb7fa911fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:45.923877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf5913-f4dc-4bc3-b367-b7fb7fa911fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:45.925240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf5913-f4dc-4bc3-b367-b7fb7fa911fe None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:45.958874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 505/1007] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:46.089871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c290a3-c244-413d-9ce8-6135bdfc692a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:46.090075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c290a3-c244-413d-9ce8-6135bdfc692a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:46.090359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c290a3-c244-413d-9ce8-6135bdfc692a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:46.091817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 503/1008] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:46.098204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d357-461b-4fce-a1d3-1617bab682b9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:46.098540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d357-461b-4fce-a1d3-1617bab682b9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:46.098720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d357-461b-4fce-a1d3-1617bab682b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:46.122244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-78f1d357-461b-4fce-a1d3-1617bab682b9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:46.123524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-78f1d357-461b-4fce-a1d3-1617bab682b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:46.197327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 506/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:46 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:46.494126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c290a3-c244-413d-9ce8-6135bdfc692a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:46.546035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:46.598506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c290a3-c244-413d-9ce8-6135bdfc692a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:46.641171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:46.641820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:46.642091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:46.642354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:46.643013 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:46.644402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:46.653515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:46.654489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:46.660389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 504/1010] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 15 07:17:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:46.661214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1d357-461b-4fce-a1d3-1617bab682b9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:46.745373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:46.763521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1d357-461b-4fce-a1d3-1617bab682b9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:46.798557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:46.799231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:46.799509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:46.799728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:46.800366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:46.800661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:46.802034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:46.810891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 507/1011] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:46.813162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:46.917587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c9ab-da82-4ae9-88e8-2ac565683fd6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:46.930927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:46.951935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fa3bf-d7a4-47e5-8fe4-9d902ad98ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:46.952540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fa3bf-d7a4-47e5-8fe4-9d902ad98ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:46.952812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fa3bf-d7a4-47e5-8fe4-9d902ad98ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:46.953075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fa3bf-d7a4-47e5-8fe4-9d902ad98ca0 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:46.953691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fa3bf-d7a4-47e5-8fe4-9d902ad98ca0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:46.953987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fa3bf-d7a4-47e5-8fe4-9d902ad98ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:46.955510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fa3bf-d7a4-47e5-8fe4-9d902ad98ca0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:46.964829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 505/1012] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 15 07:17:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:46.970792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:47.068216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfc161-3f72-4842-9aee-e37fb802f3ff None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:47.102171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87675088-2717-42d4-9056-7210e4fb9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:47.102781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675088-2717-42d4-9056-7210e4fb9011 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:47.103064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675088-2717-42d4-9056-7210e4fb9011 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:47.103357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87675088-2717-42d4-9056-7210e4fb9011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:47.104018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87675088-2717-42d4-9056-7210e4fb9011 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:47.105371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87675088-2717-42d4-9056-7210e4fb9011 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:47.122415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 508/1013] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:47.717294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0fff-3c18-4fe6-9b1f-cfb9c7fc912c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:47.717636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0fff-3c18-4fe6-9b1f-cfb9c7fc912c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:47.717839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0fff-3c18-4fe6-9b1f-cfb9c7fc912c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:47.719294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 506/1014] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:47.725147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb836a-e044-4e80-88a7-fbd246283844 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:47.725434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb836a-e044-4e80-88a7-fbd246283844 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:47.725664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb836a-e044-4e80-88a7-fbd246283844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:47.743949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cadb836a-e044-4e80-88a7-fbd246283844 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:47.745121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cadb836a-e044-4e80-88a7-fbd246283844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:47.747116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:47.819182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 509/1015] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:47 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:48.080755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0fff-3c18-4fe6-9b1f-cfb9c7fc912c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:48.193514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0fff-3c18-4fe6-9b1f-cfb9c7fc912c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:48.227447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536efba-47f5-4311-9f6c-15d2f44680e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:48.228061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536efba-47f5-4311-9f6c-15d2f44680e6 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:48.228334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536efba-47f5-4311-9f6c-15d2f44680e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:48.228603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536efba-47f5-4311-9f6c-15d2f44680e6 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:48.229249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536efba-47f5-4311-9f6c-15d2f44680e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:48.230638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536efba-47f5-4311-9f6c-15d2f44680e6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:48.246756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 507/1016] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:48 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:48.259408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312b8f-086a-4169-919e-cf99002e5c97 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:48.259736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312b8f-086a-4169-919e-cf99002e5c97 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:48.259973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312b8f-086a-4169-919e-cf99002e5c97 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:48.261669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 510/1017] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:48.267559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37017e-fe22-4827-9fad-c8cb8ad6eb78 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:48.267922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37017e-fe22-4827-9fad-c8cb8ad6eb78 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:48.268114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37017e-fe22-4827-9fad-c8cb8ad6eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:48.288660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4a37017e-fe22-4827-9fad-c8cb8ad6eb78 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:48.289906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4a37017e-fe22-4827-9fad-c8cb8ad6eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:48.327812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:48.382917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 508/1018] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:48.645260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312b8f-086a-4169-919e-cf99002e5c97 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:48.755916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312b8f-086a-4169-919e-cf99002e5c97 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:48.790003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:48.790649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:48.790942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:48.791213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:48.793129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:48.803006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:48.807757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:48.808718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:48.809583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 511/1019] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 15 07:17:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:48.816500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37017e-fe22-4827-9fad-c8cb8ad6eb78 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:48.920804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37017e-fe22-4827-9fad-c8cb8ad6eb78 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:48.956934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:48.957546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:48.957820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:48.958098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:48.958759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:48.959086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:48.960479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:48.969263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 509/1020] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 15 07:17:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:48.975553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:49.080431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e0243-4525-4ec5-a5ca-dc1589710046 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:49.115849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74c8f5-4bae-4c16-9386-60d034dc8481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:49.116486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74c8f5-4bae-4c16-9386-60d034dc8481 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.116761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74c8f5-4bae-4c16-9386-60d034dc8481 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.117036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74c8f5-4bae-4c16-9386-60d034dc8481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.127747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74c8f5-4bae-4c16-9386-60d034dc8481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:49.129253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74c8f5-4bae-4c16-9386-60d034dc8481 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-bb74c8f5-4bae-4c16-9386-60d034dc8481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:49.146896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:49.147937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:49.148873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:49.148873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:49.148873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:49.148873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 512/1021] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:49.155638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:49.188214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:49.262041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278be18-b06a-4ac7-aea4-975fca125254 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.262318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278be18-b06a-4ac7-aea4-975fca125254 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.262590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278be18-b06a-4ac7-aea4-975fca125254 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.264707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 513/1022] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:17:49.269332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec91f-c4f2-4292-b282-d2800f830c9b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:49.269712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9250b-717f-419c-88bf-1c8bbe4e4a38 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.269994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9250b-717f-419c-88bf-1c8bbe4e4a38 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.270262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9250b-717f-419c-88bf-1c8bbe4e4a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.294468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ebe9250b-717f-419c-88bf-1c8bbe4e4a38 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:49.296353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ebe9250b-717f-419c-88bf-1c8bbe4e4a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:49.305601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:49.306219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.306486 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.306752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.307428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:49.307725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:49.309118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:49.326742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 510/1023] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:49.328676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:49.357961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:49.388960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 514/1024] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:49.421751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:49.436975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501847b-a407-4cf6-a5c1-9d0f5b042fbe None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:49.478106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:49.478665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.479210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.479210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.487371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:49.488851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:49.501396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:49.502409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:49.503564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:49.506904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 511/1025] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:17:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:49.516702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9250b-717f-419c-88bf-1c8bbe4e4a38 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:49.625966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9250b-717f-419c-88bf-1c8bbe4e4a38 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:49.650524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:49.664297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:49.664926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.665197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.665459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.666295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:49.666684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:49.668163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:49.685654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 515/1026] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:17:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:49.692425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:49.725936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:49.759166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee0ae1-c0bc-43c7-911c-c201cfcfc628 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:49.794451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8852-50ca-4827-a38b-e97caed475c4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:49.800824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:49.801866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.802213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.802578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.803811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:49.805350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:49.807290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 512/1027] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:49.812635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:49.834990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:49.840566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:49.841201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.841476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.841741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.914875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:49.916328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:49.924272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d17fce-871e-4c3e-b088-107171cefccb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:49.948580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:49.961813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:49.962565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:49.962872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:49.963147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:49.963807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:49.965464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:49.998284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 513/1028] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:17:49 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:17:50.023162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 516/1029] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:50.025343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:50.102623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:50.143850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294173d-df3b-4695-9b3b-92302d64a1fe None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:50.183062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:50.183719 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.183989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.184257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.194583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:50.196129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:50.211649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:50.212843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:50.213979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:50.213979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:50.213979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:50.217540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 514/1030] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:50.218957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:50.325586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef4446-be21-480f-b94d-89d924ef9612 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:50.363285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6594-ada4-4b36-bde9-6e8302af2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:50.363893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6594-ada4-4b36-bde9-6e8302af2510 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.364172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6594-ada4-4b36-bde9-6e8302af2510 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.364441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6594-ada4-4b36-bde9-6e8302af2510 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.365081 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6594-ada4-4b36-bde9-6e8302af2510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:50.365379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6594-ada4-4b36-bde9-6e8302af2510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:50.366747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6594-ada4-4b36-bde9-6e8302af2510 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:50.368673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:50.385070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 517/1031] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:50.386685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:50.426070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697acc-24a1-402d-8b65-074d832a158a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.426393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697acc-24a1-402d-8b65-074d832a158a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.426681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697acc-24a1-402d-8b65-074d832a158a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.428214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 518/1032] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:17:50.433081 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8abf-8bbd-4c84-96ec-4624d23f9826 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.433373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8abf-8bbd-4c84-96ec-4624d23f9826 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.433710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8abf-8bbd-4c84-96ec-4624d23f9826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.456710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c70e8abf-8bbd-4c84-96ec-4624d23f9826 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:50.457918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c70e8abf-8bbd-4c84-96ec-4624d23f9826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:50.496634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d983f-3fdc-42fc-a2a3-d8488ee4e227 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:50.515031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:50.532784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 519/1033] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:50.535723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:50.536366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.536642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.536911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.543759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:50.545216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:50.556373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:50.557458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:50.558371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 515/1034] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:50.563426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8abf-8bbd-4c84-96ec-4624d23f9826 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:50.664510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8abf-8bbd-4c84-96ec-4624d23f9826 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:50.690045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:50.701306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:50.701976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.702240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.702512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.703258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:50.703559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:50.705085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:50.717022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 520/1035] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:50.723449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:50.806295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:50.825207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b460d-7db7-4f5d-bcb5-7c191f4ff4ca None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:50.864326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:50.865327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.866214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.866214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.866576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] RBAC: Adding query filter params (role.id=087bd9c4b31945639ba722e6844ed7f6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=ded85d4044b1442d95e53c859459738c) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:50.866925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:50.868375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:50.874363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 516/1036] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:50 2022] GET /identity/v3/role_assignments?user.id=ded85d4044b1442d95e53c859459738c&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=087bd9c4b31945639ba722e6844ed7f6 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:50.916986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d29d46-2306-4b0d-8487-f0bb4470aed5 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:50.957260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:50.957923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:50.958200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:50.958464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] PATH_INFO: `/v3/services/image` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:50.959082 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:50.960483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:50.970332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:50.972123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:50.972974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:50.975198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 521/1037] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Sep 15 07:17:50 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:50.978115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:51.026049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:51.088454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e653ce-c276-4c82-b93b-8cf2fd9fe9b3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:51.122948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:51.123561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:51.123831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:51.124098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:51.124714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] RBAC: Adding query filter params (name=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:51.125008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:51.126686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:51.132345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 517/1038] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:51.138388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:51.191609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:51.245550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e35b3-c5a6-45f5-b52d-e5485ba2e914 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:51.279028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:51.279652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:51.279926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:51.280196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:51.280832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] RBAC: Adding query filter params (type=image) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:51.281134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:51.282570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:51.287708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 522/1039] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:51.293535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:51.398886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179e5c4-cdb9-4795-a29b-e8dde3043890 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:51.405997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:51.434412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab1ae-eb5d-4bea-b451-cbf92eea653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:51.435066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab1ae-eb5d-4bea-b451-cbf92eea653d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:51.435341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab1ae-eb5d-4bea-b451-cbf92eea653d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:51.435609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab1ae-eb5d-4bea-b451-cbf92eea653d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:51.436311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab1ae-eb5d-4bea-b451-cbf92eea653d None admin] RBAC: Adding query filter params (interface=public, service_id=1659ad51a3904fd5accc9af756f7e0e2, region_id=RegionOne) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:51.436615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab1ae-eb5d-4bea-b451-cbf92eea653d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:51.437991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab1ae-eb5d-4bea-b451-cbf92eea653d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:51.443328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 518/1040] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:17:51 2022] GET /identity/v3/endpoints?service_id=1659ad51a3904fd5accc9af756f7e0e2&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:51.448888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:51.547528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03553e4-852a-44ed-846e-2e53d456b8ba None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:51.560409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:51.583024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d110-5f30-41bf-87c4-d5cf8c34510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:51.583648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d110-5f30-41bf-87c4-d5cf8c34510e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:51.583922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d110-5f30-41bf-87c4-d5cf8c34510e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:51.584192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d110-5f30-41bf-87c4-d5cf8c34510e None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:51.584808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d110-5f30-41bf-87c4-d5cf8c34510e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:51.586181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d110-5f30-41bf-87c4-d5cf8c34510e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:51.593098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 523/1041] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:17:51 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:17:52.192863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c054d32-3a1b-43ab-88bf-e25773e58849 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:52.193091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c054d32-3a1b-43ab-88bf-e25773e58849 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:52.193369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c054d32-3a1b-43ab-88bf-e25773e58849 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:52.195008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 519/1042] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:52.200364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddba7eb-3efd-498b-bf8e-c37bc16815a0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:52.200851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddba7eb-3efd-498b-bf8e-c37bc16815a0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:52.201221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddba7eb-3efd-498b-bf8e-c37bc16815a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:52.220153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cddba7eb-3efd-498b-bf8e-c37bc16815a0 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:52.221687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cddba7eb-3efd-498b-bf8e-c37bc16815a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:52.288813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 524/1043] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:52.555456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c054d32-3a1b-43ab-88bf-e25773e58849 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:52.664907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c054d32-3a1b-43ab-88bf-e25773e58849 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:52.699260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c2c2b-0263-4b45-b38d-da3078e9417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:52.700304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2c2b-0263-4b45-b38d-da3078e9417c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:52.700821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2c2b-0263-4b45-b38d-da3078e9417c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:52.701287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2c2b-0263-4b45-b38d-da3078e9417c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:52.702614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c2c2b-0263-4b45-b38d-da3078e9417c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:52.704372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c2c2b-0263-4b45-b38d-da3078e9417c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:52.706298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 520/1044] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:52.712257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddba7eb-3efd-498b-bf8e-c37bc16815a0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:52.815006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddba7eb-3efd-498b-bf8e-c37bc16815a0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:52.822860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:52.851851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ac7ba-d0e3-4d83-9a4a-f898216c62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:52.852479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac7ba-d0e3-4d83-9a4a-f898216c62ea None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:52.852722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac7ba-d0e3-4d83-9a4a-f898216c62ea None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:52.853020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac7ba-d0e3-4d83-9a4a-f898216c62ea None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:52.853674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ac7ba-d0e3-4d83-9a4a-f898216c62ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:52.855134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ac7ba-d0e3-4d83-9a4a-f898216c62ea None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:52.878354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 525/1045] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:17:52 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:17:53.040154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6df9c-21a3-460b-9ccb-d52117b1dd81 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:53.040415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6df9c-21a3-460b-9ccb-d52117b1dd81 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:53.040715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6df9c-21a3-460b-9ccb-d52117b1dd81 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:53.042241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 521/1046] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:53.047884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8b4d-7327-46ac-813c-54e0efedf3e4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:53.048144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8b4d-7327-46ac-813c-54e0efedf3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:53.048441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df8b4d-7327-46ac-813c-54e0efedf3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:53.067534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-83df8b4d-7327-46ac-813c-54e0efedf3e4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:53.068625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-83df8b4d-7327-46ac-813c-54e0efedf3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:53.140887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 526/1047] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:53.410189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6df9c-21a3-460b-9ccb-d52117b1dd81 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:53.453860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:53.517494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6df9c-21a3-460b-9ccb-d52117b1dd81 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:53.551673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ee13e-3ff8-430b-a075-bddc0d202a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:53.552312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ee13e-3ff8-430b-a075-bddc0d202a43 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:53.552589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ee13e-3ff8-430b-a075-bddc0d202a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:53.552855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ee13e-3ff8-430b-a075-bddc0d202a43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:53.564428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ee13e-3ff8-430b-a075-bddc0d202a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-263ee13e-3ff8-430b-a075-bddc0d202a43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:53.569323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:53.570264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:53.571167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:53.572685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 522/1048] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 15 07:17:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:53.576495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8b4d-7327-46ac-813c-54e0efedf3e4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:53.676869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:53.686157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df8b4d-7327-46ac-813c-54e0efedf3e4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:53.722203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec469d-5480-4dc2-86c7-4478ba7f40a6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:53.722430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec469d-5480-4dc2-86c7-4478ba7f40a6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:53.722704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec469d-5480-4dc2-86c7-4478ba7f40a6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:53.723495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:53.724086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 523/1049] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:17:53.724433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:53.724852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:53.725284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:53.726101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:53.726547 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:53.728087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:53.728952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c042251-5e0b-48a2-acba-5478a59c1f62 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:53.729234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c042251-5e0b-48a2-acba-5478a59c1f62 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:53.729491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c042251-5e0b-48a2-acba-5478a59c1f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:53.737404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 527/1050] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 15 07:17:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:53.742994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:53.750508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6c042251-5e0b-48a2-acba-5478a59c1f62 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:53.751821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6c042251-5e0b-48a2-acba-5478a59c1f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:53.821568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 524/1051] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:53.854480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd54786-5d2e-464f-9a6f-3e8735a3ee13 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:53.888651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:53.889279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:53.889558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:53.889830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:53.900791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:53.902244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:53.916666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:53.917607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:53.918518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:53.918518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:53.918518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:53.918518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 528/1052] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:53.924913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c042251-5e0b-48a2-acba-5478a59c1f62 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:53.953565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.027475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c042251-5e0b-48a2-acba-5478a59c1f62 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.063069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.063728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.064007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.064335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.064986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:54.065285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.066678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.078898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 525/1053] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:54.084549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.084859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.094369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.177096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.190937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb050-e299-45ca-a37d-a1b97c2ae071 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.195210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237833a-80ac-4941-8bf4-96ef8687ca0b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.226037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.226589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.226885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.227153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.227744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.229116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.231348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.232297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.232755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.233084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:54.237766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:54.239036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:54.240116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 526/1054] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:54.241523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.243130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.247869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:54.257536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:54.258677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:54.259862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 529/1055] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:54.264222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.332902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.354312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96a725-8880-4588-9ebe-69b900677ce6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.367999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ca9d3-303d-4269-86d2-d474757131e3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.392280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.393292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.393575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.394103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.394744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] RBAC: Adding query filter params (name=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:54.395079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.397398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.402433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 527/1056] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:54.408209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.409232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.409849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.410128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.410405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.411342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:54.411655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.413935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.428071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.434018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 530/1057] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:54.439695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.518224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100dfe9-6bac-4a31-9b48-363bdf59e620 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.545304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb84c71-b688-4bb1-bef0-dcfbc9774565 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.559907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.561208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.561940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.562392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.563516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] RBAC: Adding query filter params (type=image) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:54.564246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.565810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.570799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.572682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 528/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:54.578544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.586119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.586771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.587472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.587752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.599141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.600596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:54.618850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:54.620032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:54.620961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:54.620961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:54.620961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:54.620961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 531/1059] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:54.625101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.667529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.687258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6c94-e1df-4a06-99c6-e08787727745 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.723016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.723892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.724211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.724479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.725090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.726493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.732321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1af8-0f60-4992-85d4-fd4ee096ca8f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.754860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 529/1060] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:17:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:17:54.786740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.787401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.787749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.788086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.788819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:54.789194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.790681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.810202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 532/1061] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:54.811163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:54.927152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24aed-4143-4664-8112-94442253cba9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:54.965208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082786d-9a3c-4478-b5d5-2a3e15e4f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:54.965879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082786d-9a3c-4478-b5d5-2a3e15e4f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:54.966157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082786d-9a3c-4478-b5d5-2a3e15e4f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:54.966428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082786d-9a3c-4478-b5d5-2a3e15e4f5a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:54.969800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:54.975830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082786d-9a3c-4478-b5d5-2a3e15e4f5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:54.977844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082786d-9a3c-4478-b5d5-2a3e15e4f5a0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-5082786d-9a3c-4478-b5d5-2a3e15e4f5a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:54.992030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:54.993222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:54.994339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:54.996611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 530/1062] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:55.002707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:55.035241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:55.075312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e466a-6528-4484-83f2-2d6b96cc1926 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:55.076303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e466a-6528-4484-83f2-2d6b96cc1926 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:55.076802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e466a-6528-4484-83f2-2d6b96cc1926 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:55.082871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 531/1063] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:55.084808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d1aa-6a5b-4e9e-90d6-76ebea57b508 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:55.085094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d1aa-6a5b-4e9e-90d6-76ebea57b508 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:55.085376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d1aa-6a5b-4e9e-90d6-76ebea57b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:55.105624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6591d1aa-6a5b-4e9e-90d6-76ebea57b508 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:55.106850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6591d1aa-6a5b-4e9e-90d6-76ebea57b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:55.111869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e553e53-01b4-4d3b-b7aa-25e432de7e8a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:55.149861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:55.150476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:55.150747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:55.151043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:55.151736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:55.152040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:55.153466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:55.164775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 533/1064] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:55.171420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:55.186879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 532/1065] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:55.263487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:55.273703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57da2-f431-404b-bbea-39da60be7443 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:55.307134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:55.307872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:55.308224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:55.308553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/ded85d4044b1442d95e53c859459738c/roles/087bd9c4b31945639ba722e6844ed7f6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:55.310743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=ded85d4044b1442d95e53c859459738c, role_id=087bd9c4b31945639ba722e6844ed7f6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:55.312254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:55.328602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 534/1066] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:17:55 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/ded85d4044b1442d95e53c859459738c/roles/087bd9c4b31945639ba722e6844ed7f6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:17:55.453217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591d1aa-6a5b-4e9e-90d6-76ebea57b508 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:55.563401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591d1aa-6a5b-4e9e-90d6-76ebea57b508 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:55.589333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:55.600361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:55.601072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:55.601340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:55.601609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:55.612154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:55.618179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:55.619814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:55.620714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 533/1067] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:55.626549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:55.731040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a5e7d-3b5d-455b-bc18-b3de40178480 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:55.764789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:55.765400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:55.765681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:55.765941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:55.766628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:55.766957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:55.768331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:55.777859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 535/1068] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:55.783953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:55.887216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42870-dcec-4fdc-a8f0-d52db050d1e6 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:55.921267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:55.921896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:55.922170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:55.922438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] PATH_INFO: `/v3/users/ee4c4f8be9414c37ad5145d60de6a186` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:55.936112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] RBAC: Authorizing `identity:get_user(user_id=ee4c4f8be9414c37ad5145d60de6a186)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:55.937570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:55.939382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 534/1069] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:17:55 2022] GET /identity/v3/users/ee4c4f8be9414c37ad5145d60de6a186 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:55.945220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:55.961074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:56.048152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2d2fb-77d2-490f-9838-86647ee188f0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:56.082958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:56.083575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:56.083851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:56.084120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:56.150199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:56.151605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:56.165704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:56.252001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 536/1070] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:56.258108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:56.304987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:56.363026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48109bef-776b-422b-9695-6b07888a3411 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:56.397396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469201a6-4dae-4321-bf68-af2d6a8a177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:56.398034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469201a6-4dae-4321-bf68-af2d6a8a177b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:56.398362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469201a6-4dae-4321-bf68-af2d6a8a177b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:56.398636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469201a6-4dae-4321-bf68-af2d6a8a177b None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:56.399787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469201a6-4dae-4321-bf68-af2d6a8a177b None admin] RBAC: Authorizing `identity:get_project(project_id=79eada01a0bf4c24a004a52190ee51d1)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:56.401291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469201a6-4dae-4321-bf68-af2d6a8a177b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:56.407969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 535/1071] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:17:56 2022] GET /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:56.409578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:56.512518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63440cc-f56a-4b24-9a94-2a6005cbfea9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:56.526918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:56.548185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d7d43-b0d8-456e-89d3-ae2ff703664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:56.548795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7d43-b0d8-456e-89d3-ae2ff703664a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:56.549065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7d43-b0d8-456e-89d3-ae2ff703664a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:56.549330 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7d43-b0d8-456e-89d3-ae2ff703664a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:56.550045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d7d43-b0d8-456e-89d3-ae2ff703664a None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=79eada01a0bf4c24a004a52190ee51d1, user.id=ee4c4f8be9414c37ad5145d60de6a186) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:56.550346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d7d43-b0d8-456e-89d3-ae2ff703664a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:56.551793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d7d43-b0d8-456e-89d3-ae2ff703664a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:56.557321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 537/1072] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:56 2022] GET /identity/v3/role_assignments?user.id=ee4c4f8be9414c37ad5145d60de6a186&scope.project.id=79eada01a0bf4c24a004a52190ee51d1&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:56.948344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324cf12-c863-45b9-bec5-510d01ae3f2e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:56.949008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324cf12-c863-45b9-bec5-510d01ae3f2e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:56.949008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324cf12-c863-45b9-bec5-510d01ae3f2e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:56.950541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 536/1073] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:17:56.955951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcf6a-e7e3-4c6d-a78f-d7e9a298c96e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:56.956390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcf6a-e7e3-4c6d-a78f-d7e9a298c96e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:56.956466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcf6a-e7e3-4c6d-a78f-d7e9a298c96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:56.976205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ee3dcf6a-e7e3-4c6d-a78f-d7e9a298c96e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:56.977412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ee3dcf6a-e7e3-4c6d-a78f-d7e9a298c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:57.051688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 538/1074] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:17:57.319321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324cf12-c863-45b9-bec5-510d01ae3f2e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:57.428890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324cf12-c863-45b9-bec5-510d01ae3f2e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:57.442693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:57.459815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b940ac-bf70-4509-a2ba-b554bc8ff142 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:57.460109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b940ac-bf70-4509-a2ba-b554bc8ff142 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:57.460355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b940ac-bf70-4509-a2ba-b554bc8ff142 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:57.461859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 539/1075] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:17:57.466245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:57.466469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d4fba-7e48-4959-8433-75263c3fffde None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:57.466745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d4fba-7e48-4959-8433-75263c3fffde None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:57.466938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:57.467028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d4fba-7e48-4959-8433-75263c3fffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:57.467117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:57.467406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:57.485009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6e6d4fba-7e48-4959-8433-75263c3fffde None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:57.486232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6e6d4fba-7e48-4959-8433-75263c3fffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:57.540703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:57.542568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:57.555204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 540/1076] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:57.649394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 537/1077] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:57.655155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d4fba-7e48-4959-8433-75263c3fffde None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:57.696284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:57.757936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d4fba-7e48-4959-8433-75263c3fffde None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:57.792312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:57.792948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:57.793223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:57.793490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:57.803913 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:57.805364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:57.818230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:57.820149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:57.821112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:57.823714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:57.823714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:57.823714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:57.823714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 541/1078] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:57.827301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:57.835428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:57.918221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:57.928192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706b4d-f84b-473e-b211-6a290e269173 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:57.929117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54326a1a-066b-4b7b-ad26-f0f2b754badb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:57.965182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:57.965941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:57.966310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:57.966645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:57.974696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:57.975398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:57.975599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:57.975871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:57.976519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:57.976816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:57.978168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:57.978709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:57.983548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:57.984510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:57.985411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 538/1079] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 15 07:17:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:57.990500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:57.994847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 542/1080] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:58.072482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:58.106738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baba9-23e4-49f9-960e-0ff216b4e973 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:58.146328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:58.146996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.147268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.147534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:58.148215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:58.148511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:58.149900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:58.159284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 539/1081] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 15 07:17:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:58.165360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:58.272821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf08f7d-2894-42f7-b120-f4f3035ff4c0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:58.307138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:58.307818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.308056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.308319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:58.319552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:58.321083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:58.336565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:58.337752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:58.338707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:58.338707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:58.338707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:58.338707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 543/1082] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:58.343785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:58.440974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badf62b-1342-4ac6-bc56-f796cb68d25a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:58.475845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:58.476442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.476718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.476991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:58.477643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:58.477939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:58.479352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:58.480818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:58.492147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 540/1083] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:58.498001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:58.501210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:58.601981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7acd-b6d2-4f3c-9882-bb8d41e541a0 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:58.638426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf73804-a00a-4c02-8bfb-2445ada3d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:58.639094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73804-a00a-4c02-8bfb-2445ada3d49c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.639366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73804-a00a-4c02-8bfb-2445ada3d49c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.639632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73804-a00a-4c02-8bfb-2445ada3d49c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:58.647159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf73804-a00a-4c02-8bfb-2445ada3d49c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:58.648593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf73804-a00a-4c02-8bfb-2445ada3d49c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3bf73804-a00a-4c02-8bfb-2445ada3d49c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:17:58.659661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:58.660712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:58.661691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 544/1084] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 15 07:17:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:17:58.666662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:58.694184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fb18-c4d3-44f1-8f0e-e13395c134b1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.694415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fb18-c4d3-44f1-8f0e-e13395c134b1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.694717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58fb18-c4d3-44f1-8f0e-e13395c134b1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:58.696057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 545/1085] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:17:58.701603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704044-adac-4e66-9e9b-ff412f78c579 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.701877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704044-adac-4e66-9e9b-ff412f78c579 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.702143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704044-adac-4e66-9e9b-ff412f78c579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:58.724490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8b704044-adac-4e66-9e9b-ff412f78c579 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:17:58.725680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8b704044-adac-4e66-9e9b-ff412f78c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:17:58.772972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e43f85-71ab-443b-b462-e8f60f90dbc7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:58.782060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:58.793069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 546/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:17:58.807980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:58.808591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.808878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.809145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:58.809903 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:58.810199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:58.811731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:58.829059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 541/1087] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 15 07:17:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:58.834889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b704044-adac-4e66-9e9b-ff412f78c579 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:58.931193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b704044-adac-4e66-9e9b-ff412f78c579 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:58.964965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:58.965563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:58.965835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:58.966098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.025095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.035854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.037320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.060241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.115045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.137907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 547/1088] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:17:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:17:59.143791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.162403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4dc9e-edd9-4587-a2b8-95a374feb1e8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.195321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.195870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.196170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.196450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.206670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:17:59.211485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:59.212436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:17:59.213301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 542/1089] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:59.218653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.230860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.239664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d3da-dfed-48f3-9d2a-36c2bf9b2187 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.272788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.273420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.273693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.273954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.283655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.285093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:17:59.300543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:59.301582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:17:59.302723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:17:59.302723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:17:59.302723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:59.302723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 548/1090] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:59.308772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.324284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd52c-015e-4f0f-8e28-359ed2b49f66 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.338104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.363461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.364066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.364344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.364612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.365373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:59.365785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.367954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.376982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 543/1091] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:59.382878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.413857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffdca2-c96a-4735-a2fe-fbc7144e6b6d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.446448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.447018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.447311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.447583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.448224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:59.448540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.449909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.462248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 549/1092] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:59.467933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.471815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.482254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376480ae-b9b6-40ef-94d2-be1e667bafac None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.515817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.516581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.516886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.517157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] PATH_INFO: `/v3/users/ee4c4f8be9414c37ad5145d60de6a186` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.518293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] RBAC: Authorizing `identity:get_user(user_id=ee4c4f8be9414c37ad5145d60de6a186)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.519771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.521424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 544/1093] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/users/ee4c4f8be9414c37ad5145d60de6a186 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:59.527323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.565274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc18d-f27d-4976-b011-38cb3e658f1f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.569419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.598513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.599173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.599452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.599720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.606413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.607901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:17:59.619245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:17:59.620163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:17:59.621165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 550/1094] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:17:59.626196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.632681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5b891-873e-4ded-b0cc-0770e3a208e1 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.667350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.667997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.668264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.668531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.669685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] RBAC: Authorizing `identity:get_project(project_id=79eada01a0bf4c24a004a52190ee51d1)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.671165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.672932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 545/1095] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:17:59.678988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.692405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.732830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f07ebf-2315-4db1-9780-aa3a3e2980c2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.765097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.765710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.765984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.766254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.767011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:59.767311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.768742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.780362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 551/1096] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:17:59.781604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc674e6-9a42-4779-a8ce-5913d14a890e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.786989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:17:59.793862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.818485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b34cc-3d3d-4557-9b27-5d3450778dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.819183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b34cc-3d3d-4557-9b27-5d3450778dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.819464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b34cc-3d3d-4557-9b27-5d3450778dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.819737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b34cc-3d3d-4557-9b27-5d3450778dc5 None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1/users/ee4c4f8be9414c37ad5145d60de6a186/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.821680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b34cc-3d3d-4557-9b27-5d3450778dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=79eada01a0bf4c24a004a52190ee51d1, user_id=ee4c4f8be9414c37ad5145d60de6a186, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.823184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b34cc-3d3d-4557-9b27-5d3450778dc5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.836230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 546/1097] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:17:59 2022] PUT /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1/users/ee4c4f8be9414c37ad5145d60de6a186/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:17:59.886622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26ac06-6031-415e-a6d6-c0b471e59837 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:17:59.912605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:17:59.924630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdd5a4-3c33-419f-b545-5bded89ad0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:17:59.925256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd5a4-3c33-419f-b545-5bded89ad0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:17:59.925536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd5a4-3c33-419f-b545-5bded89ad0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:17:59.925806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd5a4-3c33-419f-b545-5bded89ad0f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:17:59.926550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdd5a4-3c33-419f-b545-5bded89ad0f9 None admin] RBAC: Adding query filter params (role.id=087bd9c4b31945639ba722e6844ed7f6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=ded85d4044b1442d95e53c859459738c) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:17:59.926891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdd5a4-3c33-419f-b545-5bded89ad0f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:17:59.928361 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdd5a4-3c33-419f-b545-5bded89ad0f9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:17:59.934998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 552/1098] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:17:59 2022] GET /identity/v3/role_assignments?user.id=ded85d4044b1442d95e53c859459738c&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=087bd9c4b31945639ba722e6844ed7f6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:18:01.965927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc25077-876a-4bd2-af88-068f4ef9fbdd None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:01.966492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc25077-876a-4bd2-af88-068f4ef9fbdd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:01.966492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc25077-876a-4bd2-af88-068f4ef9fbdd None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:01.967780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 547/1099] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:01.973555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6efa-5461-4061-b155-8ca8bf491308 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:01.973987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6efa-5461-4061-b155-8ca8bf491308 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:01.974137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6efa-5461-4061-b155-8ca8bf491308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:01.992822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b73d6efa-5461-4061-b155-8ca8bf491308 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:01.994028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b73d6efa-5461-4061-b155-8ca8bf491308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:02.060555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 553/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:02.326045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc25077-876a-4bd2-af88-068f4ef9fbdd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:02.447634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc25077-876a-4bd2-af88-068f4ef9fbdd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:02.493976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:02.494603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:02.494884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:02.495174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:02.506786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:18:02.511535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:02.512643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:18:02.513570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 548/1101] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:02.521577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6efa-5461-4061-b155-8ca8bf491308 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:02.631486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6efa-5461-4061-b155-8ca8bf491308 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:02.651686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:02.668972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:02.669568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:02.669840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:02.670107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:02.670757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:02.671084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:02.672446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:02.680443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 554/1102] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:02.686666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:02.717336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:02.789275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087500df-74c2-43fc-87ab-09fa716b5c3b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:02.829064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:02.829685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:02.829961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:02.830232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] PATH_INFO: `/v3/users/ee4c4f8be9414c37ad5145d60de6a186` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:02.831473 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] RBAC: Authorizing `identity:get_user(user_id=ee4c4f8be9414c37ad5145d60de6a186)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:02.832949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:02.834491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 549/1103] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:02 2022] GET /identity/v3/users/ee4c4f8be9414c37ad5145d60de6a186 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:02.841020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:02.952299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed939b0-eae4-404a-9ae2-0d482e123ee2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:02.987258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:02.987854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:02.988097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:02.988367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:03.036324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:03.055833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:03.057276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:03.159006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 555/1104] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:03.165123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:03.268583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:03.273419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c8b47-7212-4760-94a6-4b95652d2f3b None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:03.312558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61256155-13b4-4611-8ed4-42a0b83f359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:03.313233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61256155-13b4-4611-8ed4-42a0b83f359f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:03.313507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61256155-13b4-4611-8ed4-42a0b83f359f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:03.313774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61256155-13b4-4611-8ed4-42a0b83f359f None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:03.314966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61256155-13b4-4611-8ed4-42a0b83f359f None admin] RBAC: Authorizing `identity:get_project(project_id=79eada01a0bf4c24a004a52190ee51d1)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:03.316419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61256155-13b4-4611-8ed4-42a0b83f359f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:03.318042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 550/1105] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:03 2022] GET /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:03.326795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:03.408082 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:03.428496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01cc41-8114-4bfd-a572-19239a28f06e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:03.469120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ced53f-6fa7-4ebf-a63f-89879749ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:03.470013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ced53f-6fa7-4ebf-a63f-89879749ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:03.470399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ced53f-6fa7-4ebf-a63f-89879749ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:03.471044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ced53f-6fa7-4ebf-a63f-89879749ebc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:03.472180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ced53f-6fa7-4ebf-a63f-89879749ebc7 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=79eada01a0bf4c24a004a52190ee51d1, user.id=ee4c4f8be9414c37ad5145d60de6a186) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:03.472600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ced53f-6fa7-4ebf-a63f-89879749ebc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:03.474815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ced53f-6fa7-4ebf-a63f-89879749ebc7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:03.484669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 556/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:18:03 2022] GET /identity/v3/role_assignments?user.id=ee4c4f8be9414c37ad5145d60de6a186&scope.project.id=79eada01a0bf4c24a004a52190ee51d1&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:05.665489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40570-ac9e-42db-b84e-34365d4d1389 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:05.665992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40570-ac9e-42db-b84e-34365d4d1389 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:05.665992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40570-ac9e-42db-b84e-34365d4d1389 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:05.667416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 551/1107] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:05.673984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399661a-dd3a-468d-9e0a-09bba4fa292a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:05.674423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399661a-dd3a-468d-9e0a-09bba4fa292a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:05.674513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399661a-dd3a-468d-9e0a-09bba4fa292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:05.703942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d399661a-dd3a-468d-9e0a-09bba4fa292a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:05.705116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d399661a-dd3a-468d-9e0a-09bba4fa292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:05.778358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 557/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:06.043544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40570-ac9e-42db-b84e-34365d4d1389 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:06.163743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40570-ac9e-42db-b84e-34365d4d1389 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:06.208808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab063b30-22f1-4177-ae0b-d52160f52351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:06.209420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab063b30-22f1-4177-ae0b-d52160f52351 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:06.209692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab063b30-22f1-4177-ae0b-d52160f52351 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:06.209957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab063b30-22f1-4177-ae0b-d52160f52351 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:06.211193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab063b30-22f1-4177-ae0b-d52160f52351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:06.212632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab063b30-22f1-4177-ae0b-d52160f52351 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:06.214159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 552/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:06.220303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399661a-dd3a-468d-9e0a-09bba4fa292a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:06.292532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:06.319276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399661a-dd3a-468d-9e0a-09bba4fa292a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:06.357096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b79d1-2972-402b-991e-0bd91ea073db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:06.357699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b79d1-2972-402b-991e-0bd91ea073db None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:06.357972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b79d1-2972-402b-991e-0bd91ea073db None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:06.358240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b79d1-2972-402b-991e-0bd91ea073db None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:06.358923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b79d1-2972-402b-991e-0bd91ea073db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:06.360450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b79d1-2972-402b-991e-0bd91ea073db None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:06.383034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 558/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:18:06 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:18:08.550898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5ce5-e576-4071-b563-4354b173b56b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:08.551789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5ce5-e576-4071-b563-4354b173b56b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:08.551937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5ce5-e576-4071-b563-4354b173b56b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:08.554064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 553/1111] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:08.560416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fb1c7-321d-4fe6-bc21-c1795f52aa8f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:08.561095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fb1c7-321d-4fe6-bc21-c1795f52aa8f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:08.561246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fb1c7-321d-4fe6-bc21-c1795f52aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:08.582676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d25fb1c7-321d-4fe6-bc21-c1795f52aa8f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:08.584541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d25fb1c7-321d-4fe6-bc21-c1795f52aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:08.658189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 559/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:08.921238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5ce5-e576-4071-b563-4354b173b56b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:08.966059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:09.037736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5ce5-e576-4071-b563-4354b173b56b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:09.072494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:09.073108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:09.073380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:09.073645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] PATH_INFO: `/v3/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:09.075169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] RBAC: Authorizing `identity:get_role(role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:09.076536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:09.077832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 554/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:08 2022] GET /identity/v3/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:09.087318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fb1c7-321d-4fe6-bc21-c1795f52aa8f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:09.151252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:09.199437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fb1c7-321d-4fe6-bc21-c1795f52aa8f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:09.234765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:09.235411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:09.235681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:09.235949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] PATH_INFO: `/v3/users/99e0306ceeae47eea987fe5471548a40` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:09.248993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] RBAC: Authorizing `identity:get_user(user_id=99e0306ceeae47eea987fe5471548a40)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:09.250429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:09.252220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 560/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:09 2022] GET /identity/v3/users/99e0306ceeae47eea987fe5471548a40 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:09.258163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:09.364564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18122497-f5ab-435f-883d-d4353282c4b3 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:09.366068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:09.402224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:09.402858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:09.403141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:09.403408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:09.472566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:09.474780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:09.580123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 555/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:09.587121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:09.697414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fd9e-5148-4f91-92fc-9831aa23f48e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:09.715028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:09.735467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9da1-012b-44e7-85d7-102f78664077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:09.736031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9da1-012b-44e7-85d7-102f78664077 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:09.736309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9da1-012b-44e7-85d7-102f78664077 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:09.736578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9da1-012b-44e7-85d7-102f78664077 None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:09.737753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9da1-012b-44e7-85d7-102f78664077 None admin] RBAC: Authorizing `identity:get_project(project_id=79eada01a0bf4c24a004a52190ee51d1)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:09.739262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9da1-012b-44e7-85d7-102f78664077 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:09.740905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 561/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:09 2022] GET /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:09.748036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:09.751264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:09.858182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb7d3-03bc-4373-9d01-677299c670ad None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:09.894190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d20b3b-8044-45d2-ad59-972249469c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:09.894784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d20b3b-8044-45d2-ad59-972249469c3e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:09.895095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d20b3b-8044-45d2-ad59-972249469c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:09.895371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d20b3b-8044-45d2-ad59-972249469c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:09.896098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d20b3b-8044-45d2-ad59-972249469c3e None admin] RBAC: Adding query filter params (role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=79eada01a0bf4c24a004a52190ee51d1, user.id=99e0306ceeae47eea987fe5471548a40) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:09.896406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d20b3b-8044-45d2-ad59-972249469c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:09.897850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d20b3b-8044-45d2-ad59-972249469c3e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:09.903520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 556/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:18:09 2022] GET /identity/v3/role_assignments?user.id=99e0306ceeae47eea987fe5471548a40&scope.project.id=79eada01a0bf4c24a004a52190ee51d1&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:12.011271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38a9c-0cff-4cd6-b9f3-e94221ee9793 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:12.013592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38a9c-0cff-4cd6-b9f3-e94221ee9793 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:12.013592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38a9c-0cff-4cd6-b9f3-e94221ee9793 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:12.013592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 562/1118] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:12.019743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168f27-ef63-4d4b-adbb-3761a40a6e88 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:12.020446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168f27-ef63-4d4b-adbb-3761a40a6e88 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:12.020613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168f27-ef63-4d4b-adbb-3761a40a6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:12.051521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fa168f27-ef63-4d4b-adbb-3761a40a6e88 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:12.053282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fa168f27-ef63-4d4b-adbb-3761a40a6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:12.119066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:12.126927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 557/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:12.397545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38a9c-0cff-4cd6-b9f3-e94221ee9793 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:12.509157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38a9c-0cff-4cd6-b9f3-e94221ee9793 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:12.543460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:12.544076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:12.544350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:12.544614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] PATH_INFO: `/v3/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:12.545996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] RBAC: Authorizing `identity:get_role(role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:12.547444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:12.548754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 563/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:12 2022] GET /identity/v3/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:12.555486 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa168f27-ef63-4d4b-adbb-3761a40a6e88 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:12.679205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa168f27-ef63-4d4b-adbb-3761a40a6e88 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:12.716638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:12.717267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:12.717542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:12.717808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] PATH_INFO: `/v3/users/99e0306ceeae47eea987fe5471548a40` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:12.719011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] RBAC: Authorizing `identity:get_user(user_id=99e0306ceeae47eea987fe5471548a40)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:12.720844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:12.722413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 558/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:12 2022] GET /identity/v3/users/99e0306ceeae47eea987fe5471548a40 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:12.728683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:12.791398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:12.836656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad6a3d-ff32-4cc4-851b-8cf8306bc831 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:12.871962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb610a-16f7-4021-82e8-408a92bf9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:12.872579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb610a-16f7-4021-82e8-408a92bf9e41 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:12.872857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb610a-16f7-4021-82e8-408a92bf9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:12.873125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb610a-16f7-4021-82e8-408a92bf9e41 None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:12.874286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb610a-16f7-4021-82e8-408a92bf9e41 None admin] RBAC: Authorizing `identity:get_project(project_id=79eada01a0bf4c24a004a52190ee51d1)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:12.875850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb610a-16f7-4021-82e8-408a92bf9e41 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:12.877458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 564/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:12 2022] GET /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:12.883495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:12.947714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:12.997128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729bb60-7ea5-4e9b-b6ea-7dfa97087c39 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:13.033311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7560f-bb84-43b6-817b-c6789c4cb69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:13.033925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7560f-bb84-43b6-817b-c6789c4cb69b None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:13.034231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7560f-bb84-43b6-817b-c6789c4cb69b None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:13.034498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7560f-bb84-43b6-817b-c6789c4cb69b None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1/users/99e0306ceeae47eea987fe5471548a40/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:13.037074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7560f-bb84-43b6-817b-c6789c4cb69b None admin] RBAC: Authorizing `identity:create_grant(project_id=79eada01a0bf4c24a004a52190ee51d1, user_id=99e0306ceeae47eea987fe5471548a40, role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:13.038588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7560f-bb84-43b6-817b-c6789c4cb69b None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:13.054031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 559/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:18:12 2022] PUT /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1/users/99e0306ceeae47eea987fe5471548a40/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:18:15.158879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d20c5-40bb-4925-aa64-98eb3ebe43a1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:15.159422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d20c5-40bb-4925-aa64-98eb3ebe43a1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:15.159422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d20c5-40bb-4925-aa64-98eb3ebe43a1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:15.160790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 565/1124] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:15.167199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd0a4-180f-45dc-bf96-a67c02bca665 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:15.167881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd0a4-180f-45dc-bf96-a67c02bca665 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:15.168066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd0a4-180f-45dc-bf96-a67c02bca665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:15.194285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bb6dd0a4-180f-45dc-bf96-a67c02bca665 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:15.195489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bb6dd0a4-180f-45dc-bf96-a67c02bca665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:15.277303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 560/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:15.542410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d20c5-40bb-4925-aa64-98eb3ebe43a1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:15.653197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d20c5-40bb-4925-aa64-98eb3ebe43a1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:15.676703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:15.694238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:15.694901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:15.695185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:15.695453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] PATH_INFO: `/v3/roles/30c67dd0a17e4a0bb06c8b9ab0058871` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:15.696927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] RBAC: Authorizing `identity:get_role(role_id=30c67dd0a17e4a0bb06c8b9ab0058871)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:15.698318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:15.699694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 566/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:15 2022] GET /identity/v3/roles/30c67dd0a17e4a0bb06c8b9ab0058871 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:15.705683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd0a4-180f-45dc-bf96-a67c02bca665 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:15.760975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:15.809754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd0a4-180f-45dc-bf96-a67c02bca665 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:15.847671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:15.848336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:15.848610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:15.848875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] PATH_INFO: `/v3/users/99e0306ceeae47eea987fe5471548a40` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:15.850223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] RBAC: Authorizing `identity:get_user(user_id=99e0306ceeae47eea987fe5471548a40)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:15.851710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:15.853290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 561/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:15 2022] GET /identity/v3/users/99e0306ceeae47eea987fe5471548a40 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:15.859668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:15.980308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41766429-0d98-46be-b66c-481b21403d53 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:16.017639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567409c3-919a-445d-a841-135c2df8467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:16.018232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567409c3-919a-445d-a841-135c2df8467d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:16.018511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567409c3-919a-445d-a841-135c2df8467d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:16.018752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567409c3-919a-445d-a841-135c2df8467d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:16.083544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:16.093785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567409c3-919a-445d-a841-135c2df8467d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:16.095633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567409c3-919a-445d-a841-135c2df8467d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:16.198096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 567/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:16.204431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:16.311014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1d0e8-77f2-4040-bbf5-c5547f9c6feb None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:16.335916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:16.349429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ba9a8-8500-43cd-8810-f4a16bb0eab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:16.350099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ba9a8-8500-43cd-8810-f4a16bb0eab2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:16.350379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ba9a8-8500-43cd-8810-f4a16bb0eab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:16.350641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ba9a8-8500-43cd-8810-f4a16bb0eab2 None admin] PATH_INFO: `/v3/projects/79eada01a0bf4c24a004a52190ee51d1` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:16.351833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ba9a8-8500-43cd-8810-f4a16bb0eab2 None admin] RBAC: Authorizing `identity:get_project(project_id=79eada01a0bf4c24a004a52190ee51d1)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:16.353264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ba9a8-8500-43cd-8810-f4a16bb0eab2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:16.354882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 562/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:16 2022] GET /identity/v3/projects/79eada01a0bf4c24a004a52190ee51d1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:16.361453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567409c3-919a-445d-a841-135c2df8467d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:16.450860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:16.465696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567409c3-919a-445d-a841-135c2df8467d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:16.502463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104091d0-d047-4792-89a5-7a67f7d8042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:16.503097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104091d0-d047-4792-89a5-7a67f7d8042e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:16.503370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104091d0-d047-4792-89a5-7a67f7d8042e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:16.503633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104091d0-d047-4792-89a5-7a67f7d8042e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:16.504338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104091d0-d047-4792-89a5-7a67f7d8042e None admin] RBAC: Adding query filter params (role.id=30c67dd0a17e4a0bb06c8b9ab0058871, scope.project.id=79eada01a0bf4c24a004a52190ee51d1, user.id=99e0306ceeae47eea987fe5471548a40) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:16.504627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104091d0-d047-4792-89a5-7a67f7d8042e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:16.506052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104091d0-d047-4792-89a5-7a67f7d8042e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:16.511794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 568/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:18:16 2022] GET /identity/v3/role_assignments?user.id=99e0306ceeae47eea987fe5471548a40&scope.project.id=79eada01a0bf4c24a004a52190ee51d1&role.id=30c67dd0a17e4a0bb06c8b9ab0058871 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:18.671268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a5db-796a-496e-ad8f-f87c5b60aaaa None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:18.671749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a5db-796a-496e-ad8f-f87c5b60aaaa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:18.671839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a5db-796a-496e-ad8f-f87c5b60aaaa None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:18.673310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 563/1131] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:18.678793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdec87-b917-47e5-b6af-e44e2058d35e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:18.679227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdec87-b917-47e5-b6af-e44e2058d35e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:18.679387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdec87-b917-47e5-b6af-e44e2058d35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:18.698250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4bcdec87-b917-47e5-b6af-e44e2058d35e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:18.699478 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4bcdec87-b917-47e5-b6af-e44e2058d35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:18.770698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 569/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:19.031167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a5db-796a-496e-ad8f-f87c5b60aaaa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:19.145818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a5db-796a-496e-ad8f-f87c5b60aaaa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:19.181735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68771f8-2194-4396-a90a-be611901e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:19.182351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68771f8-2194-4396-a90a-be611901e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:19.182626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68771f8-2194-4396-a90a-be611901e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:19.182963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68771f8-2194-4396-a90a-be611901e9f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:19.184133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68771f8-2194-4396-a90a-be611901e9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:19.185565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68771f8-2194-4396-a90a-be611901e9f4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:19.187128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 564/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:18:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:19.193187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdec87-b917-47e5-b6af-e44e2058d35e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:19.277241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:19.300830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdec87-b917-47e5-b6af-e44e2058d35e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:19.335095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7327357-9b4e-41c4-90a5-1051f49fbbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:19.335698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7327357-9b4e-41c4-90a5-1051f49fbbbf None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:19.335972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7327357-9b4e-41c4-90a5-1051f49fbbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:19.336236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7327357-9b4e-41c4-90a5-1051f49fbbbf None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:19.336943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7327357-9b4e-41c4-90a5-1051f49fbbbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:19.338381 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7327357-9b4e-41c4-90a5-1051f49fbbbf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:19.368809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 570/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:18:19 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:18:21.546397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d567-21d0-4327-8314-10d59c998835 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:21.547083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d567-21d0-4327-8314-10d59c998835 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:21.547083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d567-21d0-4327-8314-10d59c998835 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:21.549020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 565/1135] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:21.557262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f550d-413f-497f-ae8f-9f6409730afa None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:21.557726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f550d-413f-497f-ae8f-9f6409730afa None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:21.557823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f550d-413f-497f-ae8f-9f6409730afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:21.580465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d99f550d-413f-497f-ae8f-9f6409730afa None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:21.581658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d99f550d-413f-497f-ae8f-9f6409730afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:21.653704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 571/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:18:21.919965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d567-21d0-4327-8314-10d59c998835 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:21.986018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:22.029318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d567-21d0-4327-8314-10d59c998835 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:22.066064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03648bd-bc0d-4566-b8dc-113ffd652d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:22.066679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03648bd-bc0d-4566-b8dc-113ffd652d41 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:22.066983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03648bd-bc0d-4566-b8dc-113ffd652d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:22.067253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03648bd-bc0d-4566-b8dc-113ffd652d41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:22.068478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03648bd-bc0d-4566-b8dc-113ffd652d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:22.069916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03648bd-bc0d-4566-b8dc-113ffd652d41 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:22.071505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 566/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:22.077955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f550d-413f-497f-ae8f-9f6409730afa None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:22.146810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:22.195218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f550d-413f-497f-ae8f-9f6409730afa None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:22.230982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae27759-9c0f-4a10-a676-3b9d398a55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:22.231582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27759-9c0f-4a10-a676-3b9d398a55a7 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:22.231858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27759-9c0f-4a10-a676-3b9d398a55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:22.232122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27759-9c0f-4a10-a676-3b9d398a55a7 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:22.232781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae27759-9c0f-4a10-a676-3b9d398a55a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:22.234215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae27759-9c0f-4a10-a676-3b9d398a55a7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:22.263113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 572/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:18:22 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:18:24.430292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0da38-ba6b-4499-9311-cc2d92042200 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:24.431273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0da38-ba6b-4499-9311-cc2d92042200 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:24.431273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0da38-ba6b-4499-9311-cc2d92042200 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:24.433353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 567/1139] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:24.439812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ee64-02cc-4b9c-b43a-96ea99c6b7b0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:24.440237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ee64-02cc-4b9c-b43a-96ea99c6b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:24.440391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ee64-02cc-4b9c-b43a-96ea99c6b7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:24.465220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-63f7ee64-02cc-4b9c-b43a-96ea99c6b7b0 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:24.466431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-63f7ee64-02cc-4b9c-b43a-96ea99c6b7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:24.535673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 573/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:24.805003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0da38-ba6b-4499-9311-cc2d92042200 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:24.918532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0da38-ba6b-4499-9311-cc2d92042200 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:24.943906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:24.958254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:24.959251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:24.959601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:24.959954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:24.974797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:18:24.979536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:24.980679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:18:24.981683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 568/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:24.986927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ee64-02cc-4b9c-b43a-96ea99c6b7b0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:25.042186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:25.091544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ee64-02cc-4b9c-b43a-96ea99c6b7b0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:25.127038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:25.127647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:25.127922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:25.128190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:25.128885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:25.129188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:25.130561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:25.138614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 574/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:25.144881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:25.259158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7c22b-9c38-4d3f-8a6e-413e527a27a2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:25.296078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:25.296706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:25.296977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:25.297243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] PATH_INFO: `/v3/users/b2b18a2fa0244622b2cbcba790a76905` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:25.311087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b18a2fa0244622b2cbcba790a76905)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:25.312525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:25.314077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 569/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:25 2022] GET /identity/v3/users/b2b18a2fa0244622b2cbcba790a76905 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:25.320229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:25.421731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6269699-806a-4f0d-bcde-be7941a2dff1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:25.436365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:25.459826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:25.460469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:25.460686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:25.460956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:25.527859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:25.529318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:25.644888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 575/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:25.651209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:25.700066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:25.763240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6bcb5-fa16-4486-be87-cb326f8b2ed7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:25.801209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433bc94-7f8e-462a-845a-1dae02f2e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:25.801840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433bc94-7f8e-462a-845a-1dae02f2e32a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:25.802116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433bc94-7f8e-462a-845a-1dae02f2e32a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:25.802386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433bc94-7f8e-462a-845a-1dae02f2e32a None admin] PATH_INFO: `/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:25.803501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433bc94-7f8e-462a-845a-1dae02f2e32a None admin] RBAC: Authorizing `identity:get_project(project_id=da22f1125b7e43ac8f7d5b73d54bf021)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:25.804944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433bc94-7f8e-462a-845a-1dae02f2e32a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:25.806562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 570/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:25 2022] GET /identity/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:25.813019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:25.829765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:25.934323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccd0e-338f-4767-b11f-c5679a7152d3 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:25.979877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba45da-e1f1-4508-99c8-65b99a862db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:25.980412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba45da-e1f1-4508-99c8-65b99a862db1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:25.980688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba45da-e1f1-4508-99c8-65b99a862db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:25.980961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba45da-e1f1-4508-99c8-65b99a862db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:25.981677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba45da-e1f1-4508-99c8-65b99a862db1 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=da22f1125b7e43ac8f7d5b73d54bf021, user.id=b2b18a2fa0244622b2cbcba790a76905) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:25.981980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba45da-e1f1-4508-99c8-65b99a862db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:25.983447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba45da-e1f1-4508-99c8-65b99a862db1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:25.988921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 576/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:18:25 2022] GET /identity/v3/role_assignments?user.id=b2b18a2fa0244622b2cbcba790a76905&scope.project.id=da22f1125b7e43ac8f7d5b73d54bf021&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:28.082092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e987-a08a-48c4-94d0-6530ffd9f97d None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:28.083023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e987-a08a-48c4-94d0-6530ffd9f97d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:28.083023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e987-a08a-48c4-94d0-6530ffd9f97d None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:28.085189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 571/1147] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:28.091417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c413d46-cc75-475c-acd6-44f944c7beae None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:28.092177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c413d46-cc75-475c-acd6-44f944c7beae None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:28.092308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c413d46-cc75-475c-acd6-44f944c7beae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:28.119723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7c413d46-cc75-475c-acd6-44f944c7beae None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:28.120913 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7c413d46-cc75-475c-acd6-44f944c7beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:28.189371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 577/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:28.460640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e987-a08a-48c4-94d0-6530ffd9f97d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:28.577581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e987-a08a-48c4-94d0-6530ffd9f97d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:28.590758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:28.616290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:28.616920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:28.617192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:28.617456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:28.627707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:18:28.632532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:28.633673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:18:28.634782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 572/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:28.639819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c413d46-cc75-475c-acd6-44f944c7beae None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:28.650182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:28.741009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c413d46-cc75-475c-acd6-44f944c7beae None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:28.777304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:28.777907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:28.778180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:28.778442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:28.779131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:28.779429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:28.780796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:28.788817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 578/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:18:28.795392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:28.905093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03748-c5d3-433f-b925-b85a93434cea None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:28.949045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:28.949940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:28.950273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:28.950617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] PATH_INFO: `/v3/users/b2b18a2fa0244622b2cbcba790a76905` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:28.952510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b18a2fa0244622b2cbcba790a76905)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:28.954787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:28.957208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 573/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:28 2022] GET /identity/v3/users/b2b18a2fa0244622b2cbcba790a76905 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:28.963526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:29.037276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:29.068398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553e8f-3872-408a-829e-5825f4ef5437 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:29.103433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49435a-5d4f-4ef2-9c30-6fc360b8cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:29.104084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49435a-5d4f-4ef2-9c30-6fc360b8cb79 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:29.104358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49435a-5d4f-4ef2-9c30-6fc360b8cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:29.104630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49435a-5d4f-4ef2-9c30-6fc360b8cb79 None admin] PATH_INFO: `/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:29.105880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49435a-5d4f-4ef2-9c30-6fc360b8cb79 None admin] RBAC: Authorizing `identity:get_project(project_id=da22f1125b7e43ac8f7d5b73d54bf021)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:29.107347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49435a-5d4f-4ef2-9c30-6fc360b8cb79 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:29.108967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 579/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:28 2022] GET /identity/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:29.115739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:29.165050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:29.226095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1672c2-1f77-4c03-8db2-0a80bad23591 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:29.262737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fa255-5a45-4639-8bce-3b629e85a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:29.263524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fa255-5a45-4639-8bce-3b629e85a8d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:29.263812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fa255-5a45-4639-8bce-3b629e85a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:29.264070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fa255-5a45-4639-8bce-3b629e85a8d1 None admin] PATH_INFO: `/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021/users/b2b18a2fa0244622b2cbcba790a76905/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:29.266076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fa255-5a45-4639-8bce-3b629e85a8d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=da22f1125b7e43ac8f7d5b73d54bf021, user_id=b2b18a2fa0244622b2cbcba790a76905, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:29.267545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fa255-5a45-4639-8bce-3b629e85a8d1 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:29.283189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 574/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:18:29 2022] PUT /identity/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021/users/b2b18a2fa0244622b2cbcba790a76905/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:18:31.366857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99dc3e-4240-4b34-a041-6f9b28a02d90 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:31.367477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99dc3e-4240-4b34-a041-6f9b28a02d90 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:31.367477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99dc3e-4240-4b34-a041-6f9b28a02d90 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:31.368935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 580/1154] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:31.377475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028e99-acf5-4978-ae82-8d52fca25425 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:31.378224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028e99-acf5-4978-ae82-8d52fca25425 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:31.378373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028e99-acf5-4978-ae82-8d52fca25425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:31.397554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f0028e99-acf5-4978-ae82-8d52fca25425 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:31.398754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f0028e99-acf5-4978-ae82-8d52fca25425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:31.476442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 575/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:31.752801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99dc3e-4240-4b34-a041-6f9b28a02d90 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:31.868317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99dc3e-4240-4b34-a041-6f9b28a02d90 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:31.903604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:31.904175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:31.904447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:31.904710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:31.912394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:31.917207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:18:31.922240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:31.923416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:18:31.924620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 581/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:31.929686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028e99-acf5-4978-ae82-8d52fca25425 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:31.962118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:32.036610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028e99-acf5-4978-ae82-8d52fca25425 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:32.072895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:32.073495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:32.073773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:32.074043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:32.074711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:32.075043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:32.076428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:32.084595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 576/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:32.090727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:32.196014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96dca-8692-4462-ac3d-a7f4e31d432b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:32.230967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:32.231577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:32.231848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:32.232086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] PATH_INFO: `/v3/users/b2b18a2fa0244622b2cbcba790a76905` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:32.233339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b18a2fa0244622b2cbcba790a76905)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:32.234767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:32.236351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 582/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:32 2022] GET /identity/v3/users/b2b18a2fa0244622b2cbcba790a76905 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:32.242358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:32.336927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:32.347646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96f2c-f407-406b-a1fe-c72362be619a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:32.381113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:32.381711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:32.381970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:32.382239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:32.449350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:32.450725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:32.540998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:32.551150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 577/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:32.557315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:32.626534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:32.667300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a486d17-ba92-4740-8973-c64952e3f5b1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:32.702570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179684a-f189-4a73-85ff-49b2095c668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:32.703166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179684a-f189-4a73-85ff-49b2095c668b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:32.703438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179684a-f189-4a73-85ff-49b2095c668b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:32.703709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179684a-f189-4a73-85ff-49b2095c668b None admin] PATH_INFO: `/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:32.704871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179684a-f189-4a73-85ff-49b2095c668b None admin] RBAC: Authorizing `identity:get_project(project_id=da22f1125b7e43ac8f7d5b73d54bf021)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:32.706309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179684a-f189-4a73-85ff-49b2095c668b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:32.708020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 583/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:32 2022] GET /identity/v3/projects/da22f1125b7e43ac8f7d5b73d54bf021 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:32.717943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:32.830454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d49d3-f6cf-4959-a0ff-8cf7ae4677ad None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:32.869522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937fca5-a11f-4d99-ac3b-f76438a52518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:32.870117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937fca5-a11f-4d99-ac3b-f76438a52518 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:32.870385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937fca5-a11f-4d99-ac3b-f76438a52518 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:32.870668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937fca5-a11f-4d99-ac3b-f76438a52518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:32.871443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937fca5-a11f-4d99-ac3b-f76438a52518 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=da22f1125b7e43ac8f7d5b73d54bf021, user.id=b2b18a2fa0244622b2cbcba790a76905) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:32.871742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937fca5-a11f-4d99-ac3b-f76438a52518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:32.873411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937fca5-a11f-4d99-ac3b-f76438a52518 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:32.880219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 578/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:18:32 2022] GET /identity/v3/role_assignments?user.id=b2b18a2fa0244622b2cbcba790a76905&scope.project.id=da22f1125b7e43ac8f7d5b73d54bf021&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:35.031601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc02c-ddf0-41cd-b398-848f4d9b2668 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:35.032441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc02c-ddf0-41cd-b398-848f4d9b2668 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:35.032441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc02c-ddf0-41cd-b398-848f4d9b2668 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:35.034515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 584/1162] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:35.041063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2a75-8db5-461a-95fc-377973ce97e8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:35.041519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2a75-8db5-461a-95fc-377973ce97e8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:35.041621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2a75-8db5-461a-95fc-377973ce97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:35.065044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4d8b2a75-8db5-461a-95fc-377973ce97e8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:35.066243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4d8b2a75-8db5-461a-95fc-377973ce97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:35.123451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:35.142386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 579/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:35.405697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc02c-ddf0-41cd-b398-848f4d9b2668 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:35.525767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc02c-ddf0-41cd-b398-848f4d9b2668 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:35.560772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:35.561369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:35.561644 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:35.561914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:35.564838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:35.632127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:35.633577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:35.749960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 585/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:35.759815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b2a75-8db5-461a-95fc-377973ce97e8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:35.876869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b2a75-8db5-461a-95fc-377973ce97e8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:35.911566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547105f-b7ce-41cb-9f44-46a6ce4bd7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:35.912180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547105f-b7ce-41cb-9f44-46a6ce4bd7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:35.912451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547105f-b7ce-41cb-9f44-46a6ce4bd7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:35.912718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547105f-b7ce-41cb-9f44-46a6ce4bd7f5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:35.919626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547105f-b7ce-41cb-9f44-46a6ce4bd7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:35.921083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547105f-b7ce-41cb-9f44-46a6ce4bd7f5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e547105f-b7ce-41cb-9f44-46a6ce4bd7f5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:35.932813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:35.933970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:18:35.935200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 580/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:18:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:35.943033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:35.978137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:36.042788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55fed5-b433-4501-b064-1bd63413c8bd None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:36.078062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474856ef-9142-4f2e-971c-f5f6279e5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:36.078667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474856ef-9142-4f2e-971c-f5f6279e5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:36.078976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474856ef-9142-4f2e-971c-f5f6279e5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:36.079247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474856ef-9142-4f2e-971c-f5f6279e5ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:36.079889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474856ef-9142-4f2e-971c-f5f6279e5ca7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:36.080192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474856ef-9142-4f2e-971c-f5f6279e5ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:36.081555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474856ef-9142-4f2e-971c-f5f6279e5ca7 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:36.089247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 586/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 15 07:18:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:38.208379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea065-5c82-4114-be24-e6fbb73872d2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:38.208940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea065-5c82-4114-be24-e6fbb73872d2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:38.208940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea065-5c82-4114-be24-e6fbb73872d2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:38.210264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 581/1167] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:38.216576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed39e-41ee-4bcc-8f7d-2b7bd55a0401 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:38.217271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed39e-41ee-4bcc-8f7d-2b7bd55a0401 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:38.217414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed39e-41ee-4bcc-8f7d-2b7bd55a0401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:38.240511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6a1ed39e-41ee-4bcc-8f7d-2b7bd55a0401 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:38.241703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6a1ed39e-41ee-4bcc-8f7d-2b7bd55a0401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:38.313189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 587/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:38.589871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea065-5c82-4114-be24-e6fbb73872d2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:38.647297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:38.704595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea065-5c82-4114-be24-e6fbb73872d2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:38.740001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0bcee-27e0-4214-b4f1-59813ad23c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:38.740590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bcee-27e0-4214-b4f1-59813ad23c6f None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:38.740861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bcee-27e0-4214-b4f1-59813ad23c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:38.741124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bcee-27e0-4214-b4f1-59813ad23c6f None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:38.741789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0bcee-27e0-4214-b4f1-59813ad23c6f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:38.743184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0bcee-27e0-4214-b4f1-59813ad23c6f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:38.767432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 582/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Sep 15 07:18:38 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:18:40.909802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56520e-0b6a-4f0a-92ab-cac5c7ce51a4 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:40.910348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56520e-0b6a-4f0a-92ab-cac5c7ce51a4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:40.910348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56520e-0b6a-4f0a-92ab-cac5c7ce51a4 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:40.911676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 588/1170] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:40.917189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f85c11-0139-41a4-add5-e7ffd2db37f1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:40.917628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f85c11-0139-41a4-add5-e7ffd2db37f1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:40.917729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f85c11-0139-41a4-add5-e7ffd2db37f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:40.938088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e4f85c11-0139-41a4-add5-e7ffd2db37f1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:40.939307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e4f85c11-0139-41a4-add5-e7ffd2db37f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:41.012868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 583/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:41.274747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56520e-0b6a-4f0a-92ab-cac5c7ce51a4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:41.312451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:41.401329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56520e-0b6a-4f0a-92ab-cac5c7ce51a4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:41.441514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ada75f-bf0a-421a-b9cf-e241d8f79ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:41.442227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada75f-bf0a-421a-b9cf-e241d8f79ffe None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:41.442500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada75f-bf0a-421a-b9cf-e241d8f79ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:41.442771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada75f-bf0a-421a-b9cf-e241d8f79ffe None admin] PATH_INFO: `/v3/domains/adbc53c1be7a4b5cacd15b4f41fa423f` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:41.453134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ada75f-bf0a-421a-b9cf-e241d8f79ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=adbc53c1be7a4b5cacd15b4f41fa423f)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:41.454583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ada75f-bf0a-421a-b9cf-e241d8f79ffe None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:41.456198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 589/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Sep 15 07:18:41 2022] GET /identity/v3/domains/adbc53c1be7a4b5cacd15b4f41fa423f => generated 267 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:41.465415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f85c11-0139-41a4-add5-e7ffd2db37f1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:41.508064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:41.573137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f85c11-0139-41a4-add5-e7ffd2db37f1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:41.609067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84a283-24a5-45f0-b4f5-5fc49b3546ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:41.609659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a283-24a5-45f0-b4f5-5fc49b3546ed None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:41.609932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a283-24a5-45f0-b4f5-5fc49b3546ed None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:41.610189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a283-24a5-45f0-b4f5-5fc49b3546ed None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:41.610866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84a283-24a5-45f0-b4f5-5fc49b3546ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:41.612295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84a283-24a5-45f0-b4f5-5fc49b3546ed None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:41.641612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 584/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:18:41 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:18:43.812490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9e7e-238c-451c-8b29-7255e7b77a14 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:43.813062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9e7e-238c-451c-8b29-7255e7b77a14 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:43.813062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9e7e-238c-451c-8b29-7255e7b77a14 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:43.815162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 590/1174] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:43.823369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f7ce1-aef5-4486-8d87-8ba83938e08e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:43.823835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f7ce1-aef5-4486-8d87-8ba83938e08e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:43.823934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f7ce1-aef5-4486-8d87-8ba83938e08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:43.844261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f01f7ce1-aef5-4486-8d87-8ba83938e08e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:43.845821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f01f7ce1-aef5-4486-8d87-8ba83938e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:43.917133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 585/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:18:44.184839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a9e7e-238c-451c-8b29-7255e7b77a14 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:44.280465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:44.294452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a9e7e-238c-451c-8b29-7255e7b77a14 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:44.331131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91358e2e-cfef-4732-a122-f6d1782b8e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:44.331753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358e2e-cfef-4732-a122-f6d1782b8e25 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:44.332027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358e2e-cfef-4732-a122-f6d1782b8e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:44.332307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358e2e-cfef-4732-a122-f6d1782b8e25 None admin] PATH_INFO: `/v3/domains/adbc53c1be7a4b5cacd15b4f41fa423f` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:44.333429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91358e2e-cfef-4732-a122-f6d1782b8e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=adbc53c1be7a4b5cacd15b4f41fa423f)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:44.334890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91358e2e-cfef-4732-a122-f6d1782b8e25 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:44.336488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 591/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Sep 15 07:18:44 2022] GET /identity/v3/domains/adbc53c1be7a4b5cacd15b4f41fa423f => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:44.342538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f7ce1-aef5-4486-8d87-8ba83938e08e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:44.362358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:44.445789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f7ce1-aef5-4486-8d87-8ba83938e08e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:44.480684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c3486-7826-4a71-af36-44cf4ff931fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:44.481272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c3486-7826-4a71-af36-44cf4ff931fd None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:44.481543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c3486-7826-4a71-af36-44cf4ff931fd None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:44.481808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c3486-7826-4a71-af36-44cf4ff931fd None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:44.482457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c3486-7826-4a71-af36-44cf4ff931fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:44.483914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c3486-7826-4a71-af36-44cf4ff931fd None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:44.511320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 586/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:18:44 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:18:46.683549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5f58a-ac6c-473f-ba06-a41426f3df39 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:46.684092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5f58a-ac6c-473f-ba06-a41426f3df39 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:46.684092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5f58a-ac6c-473f-ba06-a41426f3df39 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:46.685449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 592/1178] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:46.690981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082742d-0b10-435c-a4e4-596e180c208d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:46.691418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082742d-0b10-435c-a4e4-596e180c208d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:46.691511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082742d-0b10-435c-a4e4-596e180c208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:46.711623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b082742d-0b10-435c-a4e4-596e180c208d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:46.712803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b082742d-0b10-435c-a4e4-596e180c208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:46.785680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 587/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:47.052860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5f58a-ac6c-473f-ba06-a41426f3df39 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:47.173447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5f58a-ac6c-473f-ba06-a41426f3df39 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:47.206693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:47.207403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:47.207682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:47.207949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:47.218243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:18:47.223509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:47.224593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:18:47.225768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 593/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:47.230803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082742d-0b10-435c-a4e4-596e180c208d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:47.234031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:47.345995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082742d-0b10-435c-a4e4-596e180c208d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:47.381064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:47.381655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:47.381920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:47.382181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:47.382866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:47.383160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:47.384532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:47.392501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 588/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:47.399423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:47.422456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:47.508324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90484f-412f-4b56-a567-e480a470b7cc None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:47.543619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:47.544231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:47.544502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:47.544772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] PATH_INFO: `/v3/users/35b566c073fc4bd5982971c45de6f658` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:47.558857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] RBAC: Authorizing `identity:get_user(user_id=35b566c073fc4bd5982971c45de6f658)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:47.560341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:47.561923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 594/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:47 2022] GET /identity/v3/users/35b566c073fc4bd5982971c45de6f658 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:47.567952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:47.636930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:47.672162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a0f50-3584-4b21-bc5e-81caf021fd0a None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:47.706718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:47.707434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:47.707734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:47.707997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:47.777717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:47.779200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:47.845073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:47.880785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 589/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:47.887504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:47.971654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:47.998506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57efe8-cf88-4ec9-a68c-9a4d55a5d180 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:48.034551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35999041-1acf-4ed0-ba35-343f9cbc9b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:48.035205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35999041-1acf-4ed0-ba35-343f9cbc9b4e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:48.035562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35999041-1acf-4ed0-ba35-343f9cbc9b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:48.035827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35999041-1acf-4ed0-ba35-343f9cbc9b4e None admin] PATH_INFO: `/v3/projects/d63287fc464f4662a57b35a22a63266b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:48.037060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35999041-1acf-4ed0-ba35-343f9cbc9b4e None admin] RBAC: Authorizing `identity:get_project(project_id=d63287fc464f4662a57b35a22a63266b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:48.038486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35999041-1acf-4ed0-ba35-343f9cbc9b4e None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:48.040127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 595/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:47 2022] GET /identity/v3/projects/d63287fc464f4662a57b35a22a63266b => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:48.047000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:48.168132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43e706-b753-4746-be8f-a37a80d3929e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:48.205318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64bcc9-3351-46c1-a1a0-0893b46dbcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:48.205910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64bcc9-3351-46c1-a1a0-0893b46dbcee None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:48.206182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64bcc9-3351-46c1-a1a0-0893b46dbcee None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:48.206450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64bcc9-3351-46c1-a1a0-0893b46dbcee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:48.207301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64bcc9-3351-46c1-a1a0-0893b46dbcee None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=d63287fc464f4662a57b35a22a63266b, user.id=35b566c073fc4bd5982971c45de6f658) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:48.207596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64bcc9-3351-46c1-a1a0-0893b46dbcee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:48.209023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64bcc9-3351-46c1-a1a0-0893b46dbcee None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:48.214978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 590/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:18:48 2022] GET /identity/v3/role_assignments?user.id=35b566c073fc4bd5982971c45de6f658&scope.project.id=d63287fc464f4662a57b35a22a63266b&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:50.312261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d141f-8c9e-4b5f-bc41-5476959c25d9 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:50.312827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d141f-8c9e-4b5f-bc41-5476959c25d9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:50.312827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d141f-8c9e-4b5f-bc41-5476959c25d9 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:50.314165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 596/1186] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:50.320714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d201c-c1d5-4efa-9d59-2468ae634eaf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:50.321549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d201c-c1d5-4efa-9d59-2468ae634eaf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:50.321549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d201c-c1d5-4efa-9d59-2468ae634eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:50.350568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e08d201c-c1d5-4efa-9d59-2468ae634eaf None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:50.351779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e08d201c-c1d5-4efa-9d59-2468ae634eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:50.378453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:50.426716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 591/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:50.694495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d141f-8c9e-4b5f-bc41-5476959c25d9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:50.811636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d141f-8c9e-4b5f-bc41-5476959c25d9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:50.847226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:50.847937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:50.848323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:50.848693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:50.860480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:18:50.865278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:50.866351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:18:50.867995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 597/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:50.872698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d201c-c1d5-4efa-9d59-2468ae634eaf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:50.983026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d201c-c1d5-4efa-9d59-2468ae634eaf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:51.018849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:51.019490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:51.019808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:51.020074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:51.020737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:51.021046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:51.022412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:51.030501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 592/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:51.036848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:51.040745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:51.141183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee601c37-f2e8-450e-a771-95452f7aed27 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:51.176660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:51.177261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:51.177531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:51.177804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] PATH_INFO: `/v3/users/35b566c073fc4bd5982971c45de6f658` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:51.179046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] RBAC: Authorizing `identity:get_user(user_id=35b566c073fc4bd5982971c45de6f658)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:51.180465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:51.182016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 598/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:51 2022] GET /identity/v3/users/35b566c073fc4bd5982971c45de6f658 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:51.191263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:51.219802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:51.300834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890104-c030-48b1-b272-0e91107ab5b9 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:51.338341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7448-2e8c-4a47-92f5-f7caefa1c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:51.338985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7448-2e8c-4a47-92f5-f7caefa1c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:51.339259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7448-2e8c-4a47-92f5-f7caefa1c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:51.339523 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7448-2e8c-4a47-92f5-f7caefa1c9a9 None admin] PATH_INFO: `/v3/projects/d63287fc464f4662a57b35a22a63266b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:51.340769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab7448-2e8c-4a47-92f5-f7caefa1c9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d63287fc464f4662a57b35a22a63266b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:51.342228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab7448-2e8c-4a47-92f5-f7caefa1c9a9 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:51.343896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 593/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:51 2022] GET /identity/v3/projects/d63287fc464f4662a57b35a22a63266b => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:51.350580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:51.421876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:51.454848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb05bc-ae51-40a2-bb7c-73b3ca0203d1 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:51.489463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e752c-e6fb-495e-9a99-50ec7d4475af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:51.490108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e752c-e6fb-495e-9a99-50ec7d4475af None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:51.490378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e752c-e6fb-495e-9a99-50ec7d4475af None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:51.490647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e752c-e6fb-495e-9a99-50ec7d4475af None admin] PATH_INFO: `/v3/projects/d63287fc464f4662a57b35a22a63266b/users/35b566c073fc4bd5982971c45de6f658/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:51.492794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e752c-e6fb-495e-9a99-50ec7d4475af None admin] RBAC: Authorizing `identity:create_grant(project_id=d63287fc464f4662a57b35a22a63266b, user_id=35b566c073fc4bd5982971c45de6f658, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:51.494216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e752c-e6fb-495e-9a99-50ec7d4475af None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:51.508874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 599/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:18:51 2022] PUT /identity/v3/projects/d63287fc464f4662a57b35a22a63266b/users/35b566c073fc4bd5982971c45de6f658/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:18:53.659425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02634e25-88fe-4c3b-9c3b-dd4d5a08f80a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:53.659946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02634e25-88fe-4c3b-9c3b-dd4d5a08f80a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:53.659946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02634e25-88fe-4c3b-9c3b-dd4d5a08f80a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:53.661356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 594/1193] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:18:53.667721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b8f4-1ab1-443e-8b0c-45770f98a282 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:53.668174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b8f4-1ab1-443e-8b0c-45770f98a282 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:53.668268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b8f4-1ab1-443e-8b0c-45770f98a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:53.690130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3e41b8f4-1ab1-443e-8b0c-45770f98a282 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:18:53.691356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3e41b8f4-1ab1-443e-8b0c-45770f98a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:18:53.772926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 600/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:18:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:18:54.041962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02634e25-88fe-4c3b-9c3b-dd4d5a08f80a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:54.137601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:54.149028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02634e25-88fe-4c3b-9c3b-dd4d5a08f80a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:54.183325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:54.183935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:54.184202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:54.184463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:54.195529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:18:54.200188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:18:54.201270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:18:54.202152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 595/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:18:54.207932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b8f4-1ab1-443e-8b0c-45770f98a282 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:54.270073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:54.317790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b8f4-1ab1-443e-8b0c-45770f98a282 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:54.357066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:54.357660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:54.357930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:54.358193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:54.358857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:54.359178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:54.360532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:54.368544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 601/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:54.375033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:54.480083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a92-9efe-4d04-8c4c-8a9cc2d157b5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:54.516862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:54.517474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:54.517746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:54.518011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] PATH_INFO: `/v3/users/35b566c073fc4bd5982971c45de6f658` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:54.519266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] RBAC: Authorizing `identity:get_user(user_id=35b566c073fc4bd5982971c45de6f658)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:54.520781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:54.522324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 596/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 15 07:18:54 2022] GET /identity/v3/users/35b566c073fc4bd5982971c45de6f658 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:18:54.531704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:54.651822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e602c2-dbeb-47a1-9c63-a7a262960a3a None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:54.675085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:54.692632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:54.693314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:54.693592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:54.693870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:54.762631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:54.764127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:54.865105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 602/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:18:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:18:54.875993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:54.898113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:54.984200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599ccc-a991-4f6f-92cd-a404c312424e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:55.019009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0cd26-ea88-4b71-bafd-a9bb92ff3dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:55.019657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0cd26-ea88-4b71-bafd-a9bb92ff3dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:55.019929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0cd26-ea88-4b71-bafd-a9bb92ff3dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:55.020198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0cd26-ea88-4b71-bafd-a9bb92ff3dc5 None admin] PATH_INFO: `/v3/projects/d63287fc464f4662a57b35a22a63266b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:55.021415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0cd26-ea88-4b71-bafd-a9bb92ff3dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=d63287fc464f4662a57b35a22a63266b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:55.022869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0cd26-ea88-4b71-bafd-a9bb92ff3dc5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:55.024479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 597/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 15 07:18:54 2022] GET /identity/v3/projects/d63287fc464f4662a57b35a22a63266b => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:18:55.031822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:18:55.063842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:18:55.149380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826192f7-ad68-4d31-9c5d-9f03e495a0af None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:18:55.184445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81f98-3060-47b6-ae63-68b198c16a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:18:55.185036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81f98-3060-47b6-ae63-68b198c16a32 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:18:55.185308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81f98-3060-47b6-ae63-68b198c16a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:18:55.185574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81f98-3060-47b6-ae63-68b198c16a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:18:55.186284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81f98-3060-47b6-ae63-68b198c16a32 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=d63287fc464f4662a57b35a22a63266b, user.id=35b566c073fc4bd5982971c45de6f658) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:18:55.186581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81f98-3060-47b6-ae63-68b198c16a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:18:55.188045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81f98-3060-47b6-ae63-68b198c16a32 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:18:55.194209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 603/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:18:55 2022] GET /identity/v3/role_assignments?user.id=35b566c073fc4bd5982971c45de6f658&scope.project.id=d63287fc464f4662a57b35a22a63266b&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:05.014349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=57 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:05.191171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=57 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:50.911928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22297dcf-b957-4acd-97ca-1a73932aefa9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:50.912557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22297dcf-b957-4acd-97ca-1a73932aefa9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:50.912557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22297dcf-b957-4acd-97ca-1a73932aefa9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:50.916346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 598/1201] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:19:50.920548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027587d-eda1-41a4-9e03-93cef1b25da1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:50.921033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027587d-eda1-41a4-9e03-93cef1b25da1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:50.921120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027587d-eda1-41a4-9e03-93cef1b25da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:50.943959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4027587d-eda1-41a4-9e03-93cef1b25da1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:19:50.945323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4027587d-eda1-41a4-9e03-93cef1b25da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:19:51.031793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 604/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:19:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:19:51.318174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22297dcf-b957-4acd-97ca-1a73932aefa9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:51.438089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22297dcf-b957-4acd-97ca-1a73932aefa9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:51.479478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:51.480218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:51.486853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:51.486853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:51.494234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:51.495763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:19:51.511890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:19:51.513410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:19:51.514740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:19:51.514740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:19:51.514740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:19:51.514740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 599/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:19:51.520435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027587d-eda1-41a4-9e03-93cef1b25da1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:51.658817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027587d-eda1-41a4-9e03-93cef1b25da1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:51.702731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:51.709521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575115-2c91-47ba-855b-bae0368c80b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:51.710388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575115-2c91-47ba-855b-bae0368c80b8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:51.710686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575115-2c91-47ba-855b-bae0368c80b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:51.711039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575115-2c91-47ba-855b-bae0368c80b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:51.711787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575115-2c91-47ba-855b-bae0368c80b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:19:51.712149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575115-2c91-47ba-855b-bae0368c80b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:51.713681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575115-2c91-47ba-855b-bae0368c80b8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:51.729687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 605/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:51.736733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:51.807328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:51.870626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b705b51-f4a3-460d-8c5b-2b351656ba51 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:51.911095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d915d3b-2e6e-426e-a00c-dfeca22b5b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:51.911861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915d3b-2e6e-426e-a00c-dfeca22b5b2d None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:51.912296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915d3b-2e6e-426e-a00c-dfeca22b5b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:51.912907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915d3b-2e6e-426e-a00c-dfeca22b5b2d None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:51.913549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d915d3b-2e6e-426e-a00c-dfeca22b5b2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:51.915528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d915d3b-2e6e-426e-a00c-dfeca22b5b2d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:51.944128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 600/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 15 07:19:51 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:19:54.431412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7314b9-8bfd-4b08-bd12-fd576188fe25 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:54.432070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7314b9-8bfd-4b08-bd12-fd576188fe25 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:54.432070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7314b9-8bfd-4b08-bd12-fd576188fe25 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:54.433620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 606/1206] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:19:54.439403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013478-9baf-41fe-81c8-e6fec049bf41 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:54.439817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013478-9baf-41fe-81c8-e6fec049bf41 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:54.439936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013478-9baf-41fe-81c8-e6fec049bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:54.459785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-50013478-9baf-41fe-81c8-e6fec049bf41 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:19:54.461432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-50013478-9baf-41fe-81c8-e6fec049bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:19:54.538962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 601/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:19:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:19:54.822700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7314b9-8bfd-4b08-bd12-fd576188fe25 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:54.945320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7314b9-8bfd-4b08-bd12-fd576188fe25 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:54.983753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:54.984452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:54.984721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:54.984986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:54.998856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:19:55.004413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:19:55.006571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:19:55.007481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:19:55.010665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 607/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:19:55.012795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013478-9baf-41fe-81c8-e6fec049bf41 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:55.060441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:55.137217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013478-9baf-41fe-81c8-e6fec049bf41 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:55.185883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:55.186734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:55.187067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:55.187390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:55.188110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:19:55.188436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:55.190542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:55.200546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 602/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:55.206689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:55.263848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:55.320138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28c567-1f8a-4be4-a39b-f80c3ad98e7e None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:55.361849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:55.362744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:55.363330 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:55.363745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:55.376556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:55.378060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:19:55.394281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:19:55.395576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:19:55.396695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:19:55.396695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:19:55.396695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:19:55.396695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 608/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:19:55.403052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:55.516862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:55.521562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562562d-a5ba-4b78-820c-4ca5a976b3b0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:55.560445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:55.561141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:55.561414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:55.561678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:55.562313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:19:55.562648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:55.564084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:55.578481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 603/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:55.585039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:55.700739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad77a1-1a0c-4fc0-a261-77c26c02df76 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:55.702251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:55.739700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:55.740342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:55.740613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:55.740881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:55.749708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:55.751392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:19:55.763910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:19:55.764928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:19:55.771196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 609/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:19:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:19:55.771921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:55.884259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3992a-1bd8-4b9c-9bc7-a61777c9da9d None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:55.923877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:55.924496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:55.924769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:55.925035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:55.925792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:19:55.926089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:55.927643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:55.947810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 604/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 15 07:19:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:55.954148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:56.073713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4bf0-9fb9-4788-963d-26bb5a161d33 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:56.113490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:56.114099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:56.114368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:56.114632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:56.154632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:56.197508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:56.198987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:56.305580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 610/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:19:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 07:19:56.311566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:56.333099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:56.423089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550734c-697a-4b73-906b-7c0b2e9592d8 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:56.457201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:56.457867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:56.458164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:56.458433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:56.470494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:56.472211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:19:56.488785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:19:56.489984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:19:56.491136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:19:56.491136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:19:56.491136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:19:56.494980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 605/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:19:56.496288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:56.559867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:56.601164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9dd13-a8c1-4fa9-bd47-738ebf8b21c9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:56.636964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:56.637578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:56.637851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:56.638119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:56.638760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:19:56.639091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:56.640453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:56.659966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 611/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:56.661267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:56.734127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:56.769119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ec04-9953-4b2c-b30c-1e4368ac656f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:56.811408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:56.812019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:56.812298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:56.812602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:56.820200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:56.821777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:19:56.834739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:19:56.836086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:19:56.837330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 606/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:19:56.842562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:56.951977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4517c9-2b5e-4a12-a256-325dfbb81bc2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:56.977850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:56.990785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3d056-2498-423e-a1c8-1bce273960cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:56.991433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3d056-2498-423e-a1c8-1bce273960cf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:56.991712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3d056-2498-423e-a1c8-1bce273960cf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:56.992028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3d056-2498-423e-a1c8-1bce273960cf None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:56.992762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3d056-2498-423e-a1c8-1bce273960cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:19:56.993068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3d056-2498-423e-a1c8-1bce273960cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:56.994510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3d056-2498-423e-a1c8-1bce273960cf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:57.006793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 612/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:57.013186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:19:57.124393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e03c-0f22-480b-90ea-f310d7613141 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:19:57.156376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:19:57.163302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e826fe7-2e7c-42f9-9d96-5a38e001c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:19:57.163849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e826fe7-2e7c-42f9-9d96-5a38e001c276 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:57.164128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e826fe7-2e7c-42f9-9d96-5a38e001c276 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:57.164396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e826fe7-2e7c-42f9-9d96-5a38e001c276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:57.165120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e826fe7-2e7c-42f9-9d96-5a38e001c276 None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=7cd8870330414fddaca7b5d2075b4bfd) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:19:57.165443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e826fe7-2e7c-42f9-9d96-5a38e001c276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:19:57.166907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e826fe7-2e7c-42f9-9d96-5a38e001c276 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:19:57.172536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 607/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:19:57 2022] GET /identity/v3/role_assignments?user.id=7cd8870330414fddaca7b5d2075b4bfd&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:19:59.541215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb3aa6-7dd4-4048-b033-bd2cbbe8c231 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:59.541789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb3aa6-7dd4-4048-b033-bd2cbbe8c231 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:59.541789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb3aa6-7dd4-4048-b033-bd2cbbe8c231 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:59.543375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 613/1220] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:19:59.549234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61a7a9-b53f-4a3d-abfa-0112edaf0e9e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:19:59.549677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61a7a9-b53f-4a3d-abfa-0112edaf0e9e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:19:59.549825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61a7a9-b53f-4a3d-abfa-0112edaf0e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:19:59.568396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4f61a7a9-b53f-4a3d-abfa-0112edaf0e9e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:19:59.569826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4f61a7a9-b53f-4a3d-abfa-0112edaf0e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:19:59.644665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 608/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:19:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:19:59.925488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb3aa6-7dd4-4048-b033-bd2cbbe8c231 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:00.051304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb3aa6-7dd4-4048-b033-bd2cbbe8c231 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:00.086993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:00.087609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:00.087893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:00.088154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:00.098765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:20:00.103587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:00.104765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:00.105995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 614/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:00.110934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61a7a9-b53f-4a3d-abfa-0112edaf0e9e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:00.217727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61a7a9-b53f-4a3d-abfa-0112edaf0e9e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:00.242853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:00.253497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:00.254182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:00.254456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:00.254729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:00.255431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] RBAC: Adding query filter params (name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:00.255730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:00.257142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:00.265468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 609/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:20:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:20:00.271919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:00.322518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:00.400452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515a35-6c96-473c-96ce-97d19fb02145 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:00.441089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:00.441725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:00.442001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:00.442297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:00.452773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:00.454367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:00.470196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:00.471509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:00.472854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:00.472854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:00.472854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:00.472854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 615/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:00.477667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:00.589858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7635495-db8b-4bd8-ad13-f4e501f50342 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:00.630145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:00.630767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:00.631073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:00.631346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:00.632001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:00.632298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:00.633680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:00.645681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 610/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:00.651495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:00.757512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:00.764886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a905e0-0dce-4b5b-ba32-e33e9d9a04e4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:00.802073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686199-d058-4f20-a247-9644d272475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:00.802716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686199-d058-4f20-a247-9644d272475b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:00.803027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686199-d058-4f20-a247-9644d272475b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:00.803300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686199-d058-4f20-a247-9644d272475b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:00.811393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686199-d058-4f20-a247-9644d272475b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:00.812962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686199-d058-4f20-a247-9644d272475b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-78686199-d058-4f20-a247-9644d272475b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:20:00.825264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:00.831254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:00.832321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 616/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:00.832923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:00.887342 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:00.949040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31479b8-09c7-42ef-80a9-3fe56f2694a4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:00.985979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:00.986718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:00.987099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:00.987478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:00.988451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:00.988904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:00.990915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:01.010763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 611/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 15 07:20:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:01.017532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686199-d058-4f20-a247-9644d272475b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:01.124531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686199-d058-4f20-a247-9644d272475b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:01.165796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:01.166430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:01.166700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:01.166997 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:01.179002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:01.180614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:01.199995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:01.201051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:01.202403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:01.202403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:01.202403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:01.202403 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 617/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:01.207691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:01.317044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f3c04-bc56-4099-bf9b-532ebbfaa83f None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:01.319412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:01.359027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:01.359602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:01.359881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:01.360149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:01.360829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:01.361128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:01.362521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:01.374417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 612/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:01.380436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:01.389897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:01.495309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5bab3-812e-4f6e-be0d-f7faec139573 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:01.536650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:01.537287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:01.537568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:01.537832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:01.544472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:01.545949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:20:01.557420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:01.558495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:01.562091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 618/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:01.564678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:01.681297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ebc51-3713-4a68-af92-27c4409f4462 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:01.716834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a02f0a-fa38-42ab-889b-b0bdbbabb6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:01.717465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02f0a-fa38-42ab-889b-b0bdbbabb6cc None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:01.717828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02f0a-fa38-42ab-889b-b0bdbbabb6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:01.718447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02f0a-fa38-42ab-889b-b0bdbbabb6cc None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:01.719219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a02f0a-fa38-42ab-889b-b0bdbbabb6cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:01.719501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a02f0a-fa38-42ab-889b-b0bdbbabb6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:01.720964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a02f0a-fa38-42ab-889b-b0bdbbabb6cc None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:01.735190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 613/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:01.741624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:01.809092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:01.846447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf212-4768-48e3-814e-1ba21eec6838 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:01.880531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acf876-857d-4bbd-afd3-71ef78d5a437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:01.881199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf876-857d-4bbd-afd3-71ef78d5a437 None admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:01.881502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf876-857d-4bbd-afd3-71ef78d5a437 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:01.881820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf876-857d-4bbd-afd3-71ef78d5a437 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/7cd8870330414fddaca7b5d2075b4bfd/roles/19bf489599ed454d89d91d959f899a44` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:01.897051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acf876-857d-4bbd-afd3-71ef78d5a437 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=7cd8870330414fddaca7b5d2075b4bfd, role_id=19bf489599ed454d89d91d959f899a44)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:01.898513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acf876-857d-4bbd-afd3-71ef78d5a437 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:01.916009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 619/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:20:01 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/7cd8870330414fddaca7b5d2075b4bfd/roles/19bf489599ed454d89d91d959f899a44 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:20:04.132257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970df0-d35d-4969-9b9b-16c02c89b7f2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:04.132892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970df0-d35d-4969-9b9b-16c02c89b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:04.132892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970df0-d35d-4969-9b9b-16c02c89b7f2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:04.134225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 614/1233] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:04.139862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a198e-914b-4cad-a83a-13219b08b711 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:04.140334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a198e-914b-4cad-a83a-13219b08b711 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:04.140428 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a198e-914b-4cad-a83a-13219b08b711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:04.160510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a36a198e-914b-4cad-a83a-13219b08b711 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:04.161719 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a36a198e-914b-4cad-a83a-13219b08b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:04.235226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 620/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 07:20:04.507785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6970df0-d35d-4969-9b9b-16c02c89b7f2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:04.535421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:04.625830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6970df0-d35d-4969-9b9b-16c02c89b7f2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:04.664978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:04.665621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:04.665920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:04.666190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:04.677280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:20:04.682161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:04.683777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:04.685071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 615/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 15 07:20:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:20:04.689479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a198e-914b-4cad-a83a-13219b08b711 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:04.735714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:04.793433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a198e-914b-4cad-a83a-13219b08b711 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:04.826146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:04.826750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:04.827073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:04.828446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:04.829248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:04.829605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:04.831003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:04.841224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 621/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 15 07:20:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:04.847950 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:04.940467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:04.960350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364eec-8b09-4fe3-aa45-6ab28ca915b5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:04.998207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:04.998960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:04.999243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:04.999583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:05.012339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:05.013843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:05.030794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:05.032074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:05.033190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:05.033190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:05.033190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:05.033190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 616/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:05.038063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:05.147982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220addd-ce14-4785-bacc-613a92f46a9d None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:05.157630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:05.184996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:05.185634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:05.185890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:05.186207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:05.186961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:05.187244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:05.188705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:05.203357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 622/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:05.209416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:05.321197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ed6b3-fd2c-44e0-a8f5-5aa0f06c16df None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:05.366842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:05.367892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:05.368301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:05.368636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:05.373389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:05.380136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:05.382335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:20:05.395799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:05.397084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:05.398560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 617/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:05.403756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:05.510360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f42b10-11c8-462e-9243-548614a80e28 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:05.547821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:05.548438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:05.548731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:05.548982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:05.549708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:05.550006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:05.551519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:05.575258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 623/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 15 07:20:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:20:05.576501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:05.693682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a857-ca80-44a7-9bbb-11c41d8cd9e4 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:05.731088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:05.731764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:05.732098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:05.732403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:05.800559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:05.807549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:05.809030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:05.917283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 618/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:20:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 07:20:05.918633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:05.949599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:06.029005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7837f6-5d22-4518-ba77-0038ec835094 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:06.073094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:06.073740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:06.074020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:06.074294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:06.086012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:06.087493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:06.104112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:06.105471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:06.106546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:06.106546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:06.106546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:06.106546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 624/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:06.111685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:06.217688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:06.225152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36335b-f164-40d5-ad4c-45f4beb8024e None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:06.265294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:06.265901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:06.266177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:06.266410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:06.267099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:06.267399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:06.268783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:06.281716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 619/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:06.287833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:06.374960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:06.399122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d73636-b499-4d48-a758-a36bc783788c None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:06.438339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:06.439150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:06.439430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:06.439836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:06.448167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:06.449790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:20:06.462154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:06.463363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:06.464271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 625/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:06.470337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:06.582005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd6b9a-343c-4e6f-8665-91ff343c8ad5 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:06.618954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a907d-c6ab-45ec-b35e-09f3ac25e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:06.619615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a907d-c6ab-45ec-b35e-09f3ac25e503 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:06.619894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a907d-c6ab-45ec-b35e-09f3ac25e503 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:06.620159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a907d-c6ab-45ec-b35e-09f3ac25e503 None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:06.621086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a907d-c6ab-45ec-b35e-09f3ac25e503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:06.621215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a907d-c6ab-45ec-b35e-09f3ac25e503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:06.623075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a907d-c6ab-45ec-b35e-09f3ac25e503 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:06.638343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 620/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:06.645328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:06.773719 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008aef4-7300-4686-a534-83e771e2f8bf None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:06.810633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e279a03-7503-4ab3-80c8-deca9e2bb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:06.811285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e279a03-7503-4ab3-80c8-deca9e2bb30f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:06.811563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e279a03-7503-4ab3-80c8-deca9e2bb30f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:06.811834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e279a03-7503-4ab3-80c8-deca9e2bb30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:06.812566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e279a03-7503-4ab3-80c8-deca9e2bb30f None admin] RBAC: Adding query filter params (role.id=19bf489599ed454d89d91d959f899a44, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=7cd8870330414fddaca7b5d2075b4bfd) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:06.812874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e279a03-7503-4ab3-80c8-deca9e2bb30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:06.814471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e279a03-7503-4ab3-80c8-deca9e2bb30f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:06.821340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 626/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:20:06 2022] GET /identity/v3/role_assignments?user.id=7cd8870330414fddaca7b5d2075b4bfd&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=19bf489599ed454d89d91d959f899a44 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:09.243227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe275309-527f-44ee-bae5-2139a46d5122 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:09.243792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe275309-527f-44ee-bae5-2139a46d5122 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:09.243792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe275309-527f-44ee-bae5-2139a46d5122 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:09.245367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 621/1247] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:09.251994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787ebf2-6977-4018-9f7c-6d14725a34a0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:09.252450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787ebf2-6977-4018-9f7c-6d14725a34a0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:09.252554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787ebf2-6977-4018-9f7c-6d14725a34a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:09.259847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:09.273983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a787ebf2-6977-4018-9f7c-6d14725a34a0 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:09.275337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a787ebf2-6977-4018-9f7c-6d14725a34a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:09.352647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 627/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:20:09.630837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe275309-527f-44ee-bae5-2139a46d5122 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:09.651146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:09.748354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe275309-527f-44ee-bae5-2139a46d5122 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:09.785446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:09.786138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:09.786505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:09.786774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:09.798033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:20:09.803508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:09.804691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:09.805641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 622/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:09.811067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787ebf2-6977-4018-9f7c-6d14725a34a0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:09.918105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787ebf2-6977-4018-9f7c-6d14725a34a0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:09.947030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:09.952962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:09.953572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:09.953847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:09.954110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:09.954765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:09.955092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:09.956453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:09.969880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 628/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:09.971202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:10.054494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:10.079329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f0d1-b6dd-4a75-9af8-d5f157a8896c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:10.116726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:10.117387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:10.117663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:10.117928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:10.129451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:10.130959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:10.146095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:10.147293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:10.148424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:10.148424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:10.148424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:10.148424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 623/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:10.153409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:10.260013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099ac41-53cb-4b51-87e0-040587986d24 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:10.294672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:10.295366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:10.295679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:10.296016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:10.296754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:10.297103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:10.298707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:10.312629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 629/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:10.318912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:10.427317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865443d-044e-46cb-b33e-417c0adb59df None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:10.454708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:10.463286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:10.463987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:10.464298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:10.464549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:10.473977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:10.475591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:20:10.488498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:10.489709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:10.490812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 624/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:10.497792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:10.557405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:10.604598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36977e3-63a5-4ea3-86ba-0bfb8f6e7bd2 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:10.641313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:10.641979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:10.642245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:10.642572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:10.643499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:10.643846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:10.645534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:10.664236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 630/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 15 07:20:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:10.670199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:10.776332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5383f-af9f-417d-a606-5002792e0dd7 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:10.816660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:10.817206 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:10.817489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:10.817756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:10.879396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:10.894033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:10.895759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:11.011240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 625/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:20:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:20:11.017410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:11.126341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d896-14e2-4849-a05f-aa294ca20ab8 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:11.141508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:11.165374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:11.166124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:11.166397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:11.166668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:11.178251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:11.179745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:11.195481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:11.196657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:11.197709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:11.197709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:11.197709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:11.199037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 631/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:11.202616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:11.307631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:11.322480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041e7fd-42e8-4e3a-b03d-5eba5bf4b054 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:11.368782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:11.369414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:11.369696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:11.370009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:11.370724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:11.371064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:11.372662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:11.387641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 626/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:11.393867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:11.497275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e65f4-887e-4d0f-a04b-44e7dca10a32 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:11.531431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:11.531431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:11.531742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:11.531830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:11.538742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:11.540254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:20:11.551943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:11.553163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:11.554327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 632/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:11.559457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:11.666678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923bb3c-fc21-4268-8923-4b60e11f1af0 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:11.700295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91392c5d-9c7b-4eb4-b360-2b6702a5185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:11.700897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91392c5d-9c7b-4eb4-b360-2b6702a5185f None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:11.701176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91392c5d-9c7b-4eb4-b360-2b6702a5185f None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:11.701445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91392c5d-9c7b-4eb4-b360-2b6702a5185f None admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:11.702122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91392c5d-9c7b-4eb4-b360-2b6702a5185f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:11.702421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91392c5d-9c7b-4eb4-b360-2b6702a5185f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:11.703889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91392c5d-9c7b-4eb4-b360-2b6702a5185f None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:11.716989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 627/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:11.727274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:11.757275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:11.832836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3157503-3be5-4c40-8d0d-ea1544f31070 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:11.870410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea6ac5-3d64-44b3-a9d0-7dc911a7fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:11.871025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea6ac5-3d64-44b3-a9d0-7dc911a7fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:11.871298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea6ac5-3d64-44b3-a9d0-7dc911a7fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:11.871567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea6ac5-3d64-44b3-a9d0-7dc911a7fdd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:11.872280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea6ac5-3d64-44b3-a9d0-7dc911a7fdd1 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=7cd8870330414fddaca7b5d2075b4bfd) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:11.872578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea6ac5-3d64-44b3-a9d0-7dc911a7fdd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:11.874028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea6ac5-3d64-44b3-a9d0-7dc911a7fdd1 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:11.879499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 633/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:20:11 2022] GET /identity/v3/role_assignments?user.id=7cd8870330414fddaca7b5d2075b4bfd&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:13.975207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236256-e8d5-4d0e-9b44-0b29b23e36c8 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:13.975735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236256-e8d5-4d0e-9b44-0b29b23e36c8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:13.975735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87236256-e8d5-4d0e-9b44-0b29b23e36c8 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:13.977690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 628/1261] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:13.986460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7539-dd69-40b9-a2d1-178925e083be None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:13.986874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7539-dd69-40b9-a2d1-178925e083be None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:13.987077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7539-dd69-40b9-a2d1-178925e083be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:14.012964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4e4f7539-dd69-40b9-a2d1-178925e083be None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:14.014148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4e4f7539-dd69-40b9-a2d1-178925e083be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:14.081363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 634/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:20:14.358389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236256-e8d5-4d0e-9b44-0b29b23e36c8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:14.371436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:14.472480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87236256-e8d5-4d0e-9b44-0b29b23e36c8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:14.508480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:14.509094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:14.509365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:14.509624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:14.520261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:20:14.524948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:14.526000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:14.526926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 629/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:14.532550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f7539-dd69-40b9-a2d1-178925e083be None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:14.551140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:14.633220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f7539-dd69-40b9-a2d1-178925e083be None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:14.668476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:14.669065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:14.669334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:14.669597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:14.670251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:14.670559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:14.671940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:14.679918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 635/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:20:14.686277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:14.756542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:14.799962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7002-74d9-48d4-a066-bf133aaf8639 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:14.835210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:14.835825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:14.836103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:14.836369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:14.846996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:14.848515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:14.863278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:14.864344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:14.865439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:14.865439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:14.865439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:14.865439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 630/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:14.872310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:14.959831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:14.988534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914b95c-2b3c-4e32-940f-8a3954a932d4 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:15.023585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:15.024183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:15.024464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:15.024725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:15.025334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:15.025664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:15.027052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:15.038796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 636/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:15.047270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:15.146794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf20bc-3a79-47ec-831b-a89bf9ca2885 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:15.169110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:15.187434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:15.188059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:15.188334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:15.188603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:15.196286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:15.197735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:20:15.209163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:15.210213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:15.211339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 631/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:15.216459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:15.317792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d800a-c6c4-4858-b363-283a8665d332 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:15.360127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:15.360828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:15.361222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:15.361499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:15.362362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:15.362879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:15.364786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:15.374629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:15.383925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 637/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 15 07:20:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:15.390125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:15.495681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b393-acd9-4314-a825-ab5a5e1b9659 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:15.529983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:15.530594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:15.530865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:15.531171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:15.542281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:15.543762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:15.558407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:15.559673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:15.561037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:15.561037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:15.561037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:15.561037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 632/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:15.565744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:15.672060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401c03-411e-42b0-9340-6d430fcf3e1f None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:15.707200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:15.707798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:15.708073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:15.708338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:15.708967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:15.709266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:15.710630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:15.722327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 638/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:15.729032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:15.769830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:15.847083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64b2e-772e-45b7-ac83-430557dbe247 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:15.882499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:15.883163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:15.883437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:15.883710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:15.890591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:15.892096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:20:15.903482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:15.904479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:15.905422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 633/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:15.910738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:15.974932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:16.024173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e99ec-0bd0-45da-a21b-a20cac01dac9 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:16.062074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0e0c1-f84c-4871-af31-a6d0838af1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:16.062681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e0c1-f84c-4871-af31-a6d0838af1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:16.062986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e0c1-f84c-4871-af31-a6d0838af1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:16.063255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e0c1-f84c-4871-af31-a6d0838af1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:16.063946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e0c1-f84c-4871-af31-a6d0838af1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:16.064238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e0c1-f84c-4871-af31-a6d0838af1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:16.065681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e0c1-f84c-4871-af31-a6d0838af1a3 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:16.077771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 639/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:16.084117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:16.183998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:16.193954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d281a-a757-456c-832e-d09d8faadb8c None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:16.232381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcdf92-4be2-4d68-a603-77979ba63021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:16.233035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcdf92-4be2-4d68-a603-77979ba63021 None admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:16.233313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcdf92-4be2-4d68-a603-77979ba63021 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:16.233671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcdf92-4be2-4d68-a603-77979ba63021 None admin] PATH_INFO: `/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/7cd8870330414fddaca7b5d2075b4bfd/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:16.235729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcdf92-4be2-4d68-a603-77979ba63021 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee28b0a5c2f84d3c8d7ed171da908321, user_id=7cd8870330414fddaca7b5d2075b4bfd, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:16.237179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcdf92-4be2-4d68-a603-77979ba63021 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:16.252037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 634/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 15 07:20:16 2022] PUT /identity/v3/projects/ee28b0a5c2f84d3c8d7ed171da908321/users/7cd8870330414fddaca7b5d2075b4bfd/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:20:18.365602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedc533-9273-4e7a-8e79-262823c544b0 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:18.366897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedc533-9273-4e7a-8e79-262823c544b0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:18.367263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedc533-9273-4e7a-8e79-262823c544b0 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:18.369251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 640/1274] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:18.375732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018968f-c587-4904-8a4c-7949520544cd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:18.376314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018968f-c587-4904-8a4c-7949520544cd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:18.376420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018968f-c587-4904-8a4c-7949520544cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:18.400294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b018968f-c587-4904-8a4c-7949520544cd None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:18.401766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b018968f-c587-4904-8a4c-7949520544cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:18.472729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 635/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:20:18.735819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedc533-9273-4e7a-8e79-262823c544b0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:18.862673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedc533-9273-4e7a-8e79-262823c544b0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:18.880474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:18.900706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:18.901336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:18.901611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:18.901881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:18.911991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 07:20:18.916745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:18.917848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:18.918720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 641/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 15 07:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:18.923915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018968f-c587-4904-8a4c-7949520544cd None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:19.011036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:19.029962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018968f-c587-4904-8a4c-7949520544cd None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:19.065272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:19.065879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:19.066227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:19.066490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:19.067180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:19.067471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:19.068834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:19.076908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 636/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 15 07:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:19.085755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:19.187342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f32c-dc4e-4847-8e41-e19f75ff8309 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:19.224839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:19.225440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:19.225705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:19.225965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:19.236200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:19.237632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:19.252197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:19.253463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:19.254728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:19.254728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:19.254728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:19.254728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 642/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:20:19.259172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:19.370646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b92a-180a-431e-83d7-2d260a814c33 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:19.404132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:19.404731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:19.405040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:19.405310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:19.405968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:19.406264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:19.407663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:19.419904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 637/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:19.425857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:19.459162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:19.534177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d2a02-b27f-4945-852b-ac1669c0f602 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:19.569142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:19.569793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:19.570067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:19.570336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:19.577948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:19.579427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 07:20:19.590750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:19.591866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:19.593561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 643/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:19.599156 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:19.605027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:19.707792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f189c-8dbd-419e-aa53-550ccd9ecfc2 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:19.743004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:19.743534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:19.743808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:19.744072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:19.744790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:19.745095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:19.746520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:19.764240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 638/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 15 07:20:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:19.772633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:19.871899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:19.882237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2e2c-d53f-4a12-b73f-f3dca4a624ba None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:19.916696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:19.917288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:19.917562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:19.917829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:19.994124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:19.995536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:20.085923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:20.097604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 644/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 15 07:20:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 07:20:20.106534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:20.171330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:20.210545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9b521-ff0a-4872-b6d5-a513fefe3cbf None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:20.245367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:20.245921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:20.246190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:20.246449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:20.256764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:20.258206 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 07:20:20.272829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:20.273835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 07:20:20.274801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 07:20:20.274801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 07:20:20.274801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:20.274801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 639/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 07:20:20.281889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:20.382046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701df3e5-b59f-4003-9ff1-513cda56ca73 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:20.416648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:20.417249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:20.417519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:20.417807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:20.418423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:20.418721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:20.420108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:20.431251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 645/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 15 07:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:20:20.439725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:20.542359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ead75-54f4-428a-86bf-dbe653a5a357 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:20.556391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:20.577838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:20.578448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:20.578720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:20.579025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:20.585808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:20.587276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 07:20:20.598855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:20.599895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: ERROR keystone.server.flask.application Sep 15 07:20:20.600811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 640/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 15 07:20:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:20.605937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:20.656924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:20.711525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed23925-14e7-4023-8001-cbe989d74c3b None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:20.746381 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cf51e-126c-48c3-b67d-9a4a940990b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:20.747025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf51e-126c-48c3-b67d-9a4a940990b2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:20.747301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf51e-126c-48c3-b67d-9a4a940990b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:20.747580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf51e-126c-48c3-b67d-9a4a940990b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:20.748273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cf51e-126c-48c3-b67d-9a4a940990b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:20.748569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cf51e-126c-48c3-b67d-9a4a940990b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:20.750016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cf51e-126c-48c3-b67d-9a4a940990b2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:20.761951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 646/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 15 07:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:20:20.771971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:20.881266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b5056-4083-400b-b86f-a6e34755a538 None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:20.915444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30f3da-157c-4c41-8474-24449ed43f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:20.916028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30f3da-157c-4c41-8474-24449ed43f11 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:20.916306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30f3da-157c-4c41-8474-24449ed43f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:20.916579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30f3da-157c-4c41-8474-24449ed43f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:20.917301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30f3da-157c-4c41-8474-24449ed43f11 None admin] RBAC: Adding query filter params (role.id=5a0a70f71ec7488a9743c8549e28cbe6, scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321, user.id=7cd8870330414fddaca7b5d2075b4bfd) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:20.917606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30f3da-157c-4c41-8474-24449ed43f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:20.919059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30f3da-157c-4c41-8474-24449ed43f11 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:20.924837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 641/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 15 07:20:20 2022] GET /identity/v3/role_assignments?user.id=7cd8870330414fddaca7b5d2075b4bfd&scope.project.id=ee28b0a5c2f84d3c8d7ed171da908321&role.id=5a0a70f71ec7488a9743c8549e28cbe6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:23.057689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2911713-caf1-4391-ad3f-b3057674fb93 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:23.058218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2911713-caf1-4391-ad3f-b3057674fb93 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:23.058218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2911713-caf1-4391-ad3f-b3057674fb93 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:23.059547 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 647/1288] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:23.065861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aef2f9-7690-4a6d-96cb-b940832aca23 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:23.066333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aef2f9-7690-4a6d-96cb-b940832aca23 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:23.066515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aef2f9-7690-4a6d-96cb-b940832aca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:23.086836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d9aef2f9-7690-4a6d-96cb-b940832aca23 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:23.088049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d9aef2f9-7690-4a6d-96cb-b940832aca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:23.128210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:23.172004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 642/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:20:23.431828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2911713-caf1-4391-ad3f-b3057674fb93 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:23.542500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2911713-caf1-4391-ad3f-b3057674fb93 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:23.553003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:23.578933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:23.579559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:23.579834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:23.580100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:23.580656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:23.582042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:23.590917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:23.592111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:23.593489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 648/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:20:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:23.599468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aef2f9-7690-4a6d-96cb-b940832aca23 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:23.709962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aef2f9-7690-4a6d-96cb-b940832aca23 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:23.747136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a94e6-6cd5-4a49-bbee-41143a5fc865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:23.747735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a94e6-6cd5-4a49-bbee-41143a5fc865 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:23.748008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a94e6-6cd5-4a49-bbee-41143a5fc865 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:23.748273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a94e6-6cd5-4a49-bbee-41143a5fc865 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:23.748892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a94e6-6cd5-4a49-bbee-41143a5fc865 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:23.749192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a94e6-6cd5-4a49-bbee-41143a5fc865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:23.750570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a94e6-6cd5-4a49-bbee-41143a5fc865 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:23.755578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 643/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 15 07:20:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:23.761713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:23.867701 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eaeb4-0865-4564-902f-7562be84cdeb None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:23.901488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a8bde-7d6b-4400-9582-af588359a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:23.902083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a8bde-7d6b-4400-9582-af588359a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:23.902352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a8bde-7d6b-4400-9582-af588359a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:23.902614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a8bde-7d6b-4400-9582-af588359a7d2 None admin] PATH_INFO: `/v3/services` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:23.903265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a8bde-7d6b-4400-9582-af588359a7d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:23.903564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a8bde-7d6b-4400-9582-af588359a7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:23.904914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a8bde-7d6b-4400-9582-af588359a7d2 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:23.909401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 649/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 15 07:20:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:26.025795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89239bd-16e0-41f5-b74c-a178f01b8386 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:26.026349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89239bd-16e0-41f5-b74c-a178f01b8386 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:26.026349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89239bd-16e0-41f5-b74c-a178f01b8386 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:26.027622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 644/1293] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:26.033947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ea00a-a1fd-4253-8e98-2af41d62740f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:26.034782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ea00a-a1fd-4253-8e98-2af41d62740f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:26.034895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ea00a-a1fd-4253-8e98-2af41d62740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:26.054621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-917ea00a-a1fd-4253-8e98-2af41d62740f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:26.055829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-917ea00a-a1fd-4253-8e98-2af41d62740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:26.087167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:26.130299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 650/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:20:26.399194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89239bd-16e0-41f5-b74c-a178f01b8386 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:26.442691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:26.522569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89239bd-16e0-41f5-b74c-a178f01b8386 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:26.558490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d8e23-e3c3-4302-b206-a4d330a90ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:26.559118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d8e23-e3c3-4302-b206-a4d330a90ad7 None admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:26.559394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d8e23-e3c3-4302-b206-a4d330a90ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:26.559655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d8e23-e3c3-4302-b206-a4d330a90ad7 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:26.560304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d8e23-e3c3-4302-b206-a4d330a90ad7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:26.561677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d8e23-e3c3-4302-b206-a4d330a90ad7 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:26.582674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 645/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 15 07:20:26 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:20:28.721138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383db27-962e-4434-ae2b-5d1a0c7f7ad5 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:28.721972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383db27-962e-4434-ae2b-5d1a0c7f7ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:28.721972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383db27-962e-4434-ae2b-5d1a0c7f7ad5 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:28.724257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 651/1296] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:28.729713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f45689-c19d-4e18-ab72-36e9e80a2065 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:28.730154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f45689-c19d-4e18-ab72-36e9e80a2065 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:28.730258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f45689-c19d-4e18-ab72-36e9e80a2065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:28.749369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e8f45689-c19d-4e18-ab72-36e9e80a2065 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:28.750544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e8f45689-c19d-4e18-ab72-36e9e80a2065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:28.825290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 646/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:20:29.089059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383db27-962e-4434-ae2b-5d1a0c7f7ad5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:29.203423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383db27-962e-4434-ae2b-5d1a0c7f7ad5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:29.238093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:29.238703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:29.239007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:29.239274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:29.239847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:29.241211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:29.250133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:29.251318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:29.252435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 652/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:20:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:29.257394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f45689-c19d-4e18-ab72-36e9e80a2065 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:29.276572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:29.364021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f45689-c19d-4e18-ab72-36e9e80a2065 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:29.402585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:29.403206 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:29.403476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:29.403740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:29.404397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] RBAC: Adding query filter params (name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:29.404708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:29.406079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:29.411663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 647/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 15 07:20:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:29.418486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:29.453790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:29.523890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21eb72-20d5-45ee-9a0e-a53a174b4874 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:29.559008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2cb29-8868-44d2-8f0f-420c776ccb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:29.559607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2cb29-8868-44d2-8f0f-420c776ccb60 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:29.559881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2cb29-8868-44d2-8f0f-420c776ccb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:29.560151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2cb29-8868-44d2-8f0f-420c776ccb60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:29.560844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2cb29-8868-44d2-8f0f-420c776ccb60 None admin] RBAC: Adding query filter params (interface=public, service_id=01ef715d22b14a75bb5a0bd58c67d3ec, region_id=RegionOne) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:29.561148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2cb29-8868-44d2-8f0f-420c776ccb60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:29.562510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2cb29-8868-44d2-8f0f-420c776ccb60 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:29.567924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 653/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 15 07:20:29 2022] GET /identity/v3/endpoints?service_id=01ef715d22b14a75bb5a0bd58c67d3ec&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:20:29.573979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:29.659972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:29.678443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54bfe-8f52-4bb7-b108-7d3687ab69da None admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:29.714718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384e469-de7c-4437-9c76-5e80d7ce2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:29.715354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e469-de7c-4437-9c76-5e80d7ce2f50 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:29.715631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e469-de7c-4437-9c76-5e80d7ce2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:29.715900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e469-de7c-4437-9c76-5e80d7ce2f50 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:29.716503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384e469-de7c-4437-9c76-5e80d7ce2f50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:29.718264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384e469-de7c-4437-9c76-5e80d7ce2f50 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:29.724932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 648/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 15 07:20:29 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:20:31.862741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d55de3-79c0-48a4-9223-772bd75efe9e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:31.863637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d55de3-79c0-48a4-9223-772bd75efe9e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:31.863637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d55de3-79c0-48a4-9223-772bd75efe9e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:31.865783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 654/1302] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:20:31.872157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d568-c1d8-4749-87c3-a177455abb30 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:31.872944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d568-c1d8-4749-87c3-a177455abb30 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:31.873099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d568-c1d8-4749-87c3-a177455abb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:31.893808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8066d568-c1d8-4749-87c3-a177455abb30 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:20:31.894957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8066d568-c1d8-4749-87c3-a177455abb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:20:31.963983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 649/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:20:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 07:20:32.228258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d55de3-79c0-48a4-9223-772bd75efe9e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:32.338560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:32.348441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d55de3-79c0-48a4-9223-772bd75efe9e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:32.385466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:32.386288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:32.386432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:32.386787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:32.387566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:32.389292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 07:20:32.398501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 07:20:32.399753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application with Lock( Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self._enter() Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application return self.creator() Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application created_value = creator( Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: ERROR keystone.server.flask.application Sep 15 07:20:32.401015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 655/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 15 07:20:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 07:20:32.405858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066d568-c1d8-4749-87c3-a177455abb30 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:32.483004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:32.506931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066d568-c1d8-4749-87c3-a177455abb30 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:32.541832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8a8a-82f9-4ca5-b4af-5bc17840d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:32.542421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8a8a-82f9-4ca5-b4af-5bc17840d170 None admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:32.542687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8a8a-82f9-4ca5-b4af-5bc17840d170 None admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:32.542976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8a8a-82f9-4ca5-b4af-5bc17840d170 None admin] PATH_INFO: `/v3/services` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:32.543600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8a8a-82f9-4ca5-b4af-5bc17840d170 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:20:32.543889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8a8a-82f9-4ca5-b4af-5bc17840d170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:32.545249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8a8a-82f9-4ca5-b4af-5bc17840d170 None admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:32.550384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 650/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 15 07:20:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:20:32.559607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:20:32.670511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef65e0-8977-4517-b0cb-20babdab5076 None admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:20:32.706275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d80d4e-86df-4e22-ac0b-15ce5f8c4d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:20:32.706867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80d4e-86df-4e22-ac0b-15ce5f8c4d40 None admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:20:32.707177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80d4e-86df-4e22-ac0b-15ce5f8c4d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:20:32.707517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d80d4e-86df-4e22-ac0b-15ce5f8c4d40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:20:32.708190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d80d4e-86df-4e22-ac0b-15ce5f8c4d40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:20:32.709552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d80d4e-86df-4e22-ac0b-15ce5f8c4d40 None admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:20:32.733551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 656/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:20:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:20:42.547727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=30 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:20:42.728669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:36.255769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57c57-9c05-45b2-bdba-484bbd930e01 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:36.256240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57c57-9c05-45b2-bdba-484bbd930e01 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:36.256460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57c57-9c05-45b2-bdba-484bbd930e01 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:36.262907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c521d6-3af0-4d2d-accc-ba07aa130de7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:36.263301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c521d6-3af0-4d2d-accc-ba07aa130de7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:36.263603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c521d6-3af0-4d2d-accc-ba07aa130de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:36.266414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 651/1307] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:21:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:36.348362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c1c521d6-3af0-4d2d-accc-ba07aa130de7 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:36.349653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c1c521d6-3af0-4d2d-accc-ba07aa130de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:36.583048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 657/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:21:36.874309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ba96-a8c1-41d5-a8a4-14685c1aefd2 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:36.874589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ba96-a8c1-41d5-a8a4-14685c1aefd2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:36.875083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ba96-a8c1-41d5-a8a4-14685c1aefd2 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:36.876658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 652/1309] 10.222.0.15 () {54 vars in 965 bytes} [Thu Sep 15 07:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:36.883015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4331-e907-4eab-9df0-8b4ffd375b6b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:36.883400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4331-e907-4eab-9df0-8b4ffd375b6b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:36.883750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4331-e907-4eab-9df0-8b4ffd375b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:36.964614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d2fc4331-e907-4eab-9df0-8b4ffd375b6b None None] MFA Rules not processed for user `9308f360df864174967889252718bc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:36.965930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d2fc4331-e907-4eab-9df0-8b4ffd375b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:36.987571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:37.057546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 658/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Sep 15 07:21:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:21:37.058484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ba96-a8c1-41d5-a8a4-14685c1aefd2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:21:37.060414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2a32ba96-a8c1-41d5-a8a4-14685c1aefd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:37.189456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ba96-a8c1-41d5-a8a4-14685c1aefd2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:21:37.292127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c70e4-b3f1-4a5a-a1ee-cbb4713f493e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:21:37.293593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c70e4-b3f1-4a5a-a1ee-cbb4713f493e service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:37.294081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c70e4-b3f1-4a5a-a1ee-cbb4713f493e service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:37.294627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c70e4-b3f1-4a5a-a1ee-cbb4713f493e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:37.296705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-593c70e4-b3f1-4a5a-a1ee-cbb4713f493e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:37.366265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:37.433715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c70e4-b3f1-4a5a-a1ee-cbb4713f493e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:21:37.435324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c70e4-b3f1-4a5a-a1ee-cbb4713f493e service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:21:37.456137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 653/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:21:39.926190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d27f-281b-4f1e-8f49-36959e092cc0 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:39.926723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d27f-281b-4f1e-8f49-36959e092cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:39.926723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d27f-281b-4f1e-8f49-36959e092cc0 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:39.928030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 659/1312] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:39.933512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61a7a-e433-4c77-8f09-a270fdfd31da None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:39.933951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61a7a-e433-4c77-8f09-a270fdfd31da None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:39.934043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61a7a-e433-4c77-8f09-a270fdfd31da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:40.011128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-41a61a7a-e433-4c77-8f09-a270fdfd31da None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:40.012337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-41a61a7a-e433-4c77-8f09-a270fdfd31da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:40.105793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 654/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:21:40.389908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504d27f-281b-4f1e-8f49-36959e092cc0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:21:40.392476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c504d27f-281b-4f1e-8f49-36959e092cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:40.513122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504d27f-281b-4f1e-8f49-36959e092cc0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:21:40.584460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:40.587059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22b17-ca23-4fbe-bc35-a56a1235bb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:21:40.587829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b17-ca23-4fbe-bc35-a56a1235bb5e service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:40.588113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b17-ca23-4fbe-bc35-a56a1235bb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:40.588408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b17-ca23-4fbe-bc35-a56a1235bb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:40.590780 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-08e22b17-ca23-4fbe-bc35-a56a1235bb5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:40.711325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22b17-ca23-4fbe-bc35-a56a1235bb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:21:40.712702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22b17-ca23-4fbe-bc35-a56a1235bb5e service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:21:40.731847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 660/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:21:43.220186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406220da-ff7e-4fe2-bb80-b34048f36863 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:43.221073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406220da-ff7e-4fe2-bb80-b34048f36863 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:43.221073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406220da-ff7e-4fe2-bb80-b34048f36863 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:43.222717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 655/1315] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:21:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:43.228248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3676e-9737-48ce-89e9-52edc1748dab None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:43.228665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3676e-9737-48ce-89e9-52edc1748dab None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:43.228775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3676e-9737-48ce-89e9-52edc1748dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:43.295666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a4e3676e-9737-48ce-89e9-52edc1748dab None None] MFA Rules not processed for user `d0e577d4147e404ca97862a7fb601d97`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:43.296892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a4e3676e-9737-48ce-89e9-52edc1748dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:43.351949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:43.397448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 661/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:21:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:21:43.692261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2957b18-d799-470c-87e9-cca59b9c983d None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:43.692510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2957b18-d799-470c-87e9-cca59b9c983d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:43.692895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2957b18-d799-470c-87e9-cca59b9c983d None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:43.694445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 656/1317] 10.222.0.15 () {54 vars in 965 bytes} [Thu Sep 15 07:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:43.700417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f117c0-d8ba-48fd-ab22-e59106c2720b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:43.700707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f117c0-d8ba-48fd-ab22-e59106c2720b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:43.700978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f117c0-d8ba-48fd-ab22-e59106c2720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:43.779937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-60f117c0-d8ba-48fd-ab22-e59106c2720b None None] MFA Rules not processed for user `9308f360df864174967889252718bc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:43.781133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-60f117c0-d8ba-48fd-ab22-e59106c2720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:43.858844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 662/1318] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Sep 15 07:21:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:21:43.872413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2957b18-d799-470c-87e9-cca59b9c983d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:21:43.873973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c2957b18-d799-470c-87e9-cca59b9c983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:43.884324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:43.980675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2957b18-d799-470c-87e9-cca59b9c983d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:21:44.070038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278ea8c-7df8-47a4-a9f7-658a8e801c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:21:44.070652 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ea8c-7df8-47a4-a9f7-658a8e801c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:44.070935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ea8c-7df8-47a4-a9f7-658a8e801c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:44.071208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ea8c-7df8-47a4-a9f7-658a8e801c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:44.072834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2278ea8c-7df8-47a4-a9f7-658a8e801c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:44.137629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:44.187096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278ea8c-7df8-47a4-a9f7-658a8e801c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:21:44.188541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278ea8c-7df8-47a4-a9f7-658a8e801c38 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:21:44.207339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 657/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:21:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:21:47.256812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4721-6534-4550-8f0a-7ba7dc1ec472 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:47.257728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4721-6534-4550-8f0a-7ba7dc1ec472 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:47.257728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4721-6534-4550-8f0a-7ba7dc1ec472 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:47.260040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 663/1320] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:21:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:47.265503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f6b08-30d1-4dff-857b-c489973987bd None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:47.265952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f6b08-30d1-4dff-857b-c489973987bd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:47.266048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f6b08-30d1-4dff-857b-c489973987bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:47.334420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e60f6b08-30d1-4dff-857b-c489973987bd None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:47.335638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e60f6b08-30d1-4dff-857b-c489973987bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:47.455164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 658/1321] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:21:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:21:47.737868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4721-6534-4550-8f0a-7ba7dc1ec472 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:21:47.739472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-005f4721-6534-4550-8f0a-7ba7dc1ec472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:47.792189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:47.847635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4721-6534-4550-8f0a-7ba7dc1ec472 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:21:47.926486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de0862-5413-4f15-b206-271034efb356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:21:47.927047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de0862-5413-4f15-b206-271034efb356 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:47.927321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de0862-5413-4f15-b206-271034efb356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:47.927586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de0862-5413-4f15-b206-271034efb356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:47.929158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-88de0862-5413-4f15-b206-271034efb356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:48.027939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:48.042561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de0862-5413-4f15-b206-271034efb356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:21:48.044084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de0862-5413-4f15-b206-271034efb356 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:21:48.063799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 664/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:21:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:21:50.915429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4c67-4083-4406-9001-7f54732dadd9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:50.915978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4c67-4083-4406-9001-7f54732dadd9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:50.915978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4c67-4083-4406-9001-7f54732dadd9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:50.917219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 659/1323] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:50.922542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a262e6-27aa-44b0-ba99-c6ea03768aca None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:50.923015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a262e6-27aa-44b0-ba99-c6ea03768aca None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:50.923123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a262e6-27aa-44b0-ba99-c6ea03768aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:50.999236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-13a262e6-27aa-44b0-ba99-c6ea03768aca None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:51.000590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-13a262e6-27aa-44b0-ba99-c6ea03768aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:51.108873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 665/1324] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:21:51.386250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f4c67-4083-4406-9001-7f54732dadd9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:21:51.387855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-076f4c67-4083-4406-9001-7f54732dadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:51.408485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:51.494693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f4c67-4083-4406-9001-7f54732dadd9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:21:51.569210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42556fc3-492f-4729-ab63-9fc068e2291d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:21:51.569820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42556fc3-492f-4729-ab63-9fc068e2291d service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:51.570091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42556fc3-492f-4729-ab63-9fc068e2291d service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:51.570351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42556fc3-492f-4729-ab63-9fc068e2291d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:51.571985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-42556fc3-492f-4729-ab63-9fc068e2291d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:51.645059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:51.684497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42556fc3-492f-4729-ab63-9fc068e2291d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:21:51.685966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42556fc3-492f-4729-ab63-9fc068e2291d service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:21:51.703722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 660/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:21:53.879977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c29b5-f742-46d1-8013-9451ee460da1 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:53.880527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c29b5-f742-46d1-8013-9451ee460da1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:53.880527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c29b5-f742-46d1-8013-9451ee460da1 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:53.881775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 666/1326] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:53.887144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cabf9a-9bee-427c-b84a-2523feb5358e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:53.887591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cabf9a-9bee-427c-b84a-2523feb5358e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:53.887688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cabf9a-9bee-427c-b84a-2523feb5358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:53.955378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-91cabf9a-9bee-427c-b84a-2523feb5358e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:53.956641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-91cabf9a-9bee-427c-b84a-2523feb5358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:54.066463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 661/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:21:54.343686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c29b5-f742-46d1-8013-9451ee460da1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:21:54.345282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-131c29b5-f742-46d1-8013-9451ee460da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:54.411137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:54.456326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c29b5-f742-46d1-8013-9451ee460da1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:21:54.529767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6262637-ee46-4f9e-a375-3e5125651257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:21:54.530381 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6262637-ee46-4f9e-a375-3e5125651257 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:54.530654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6262637-ee46-4f9e-a375-3e5125651257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:54.530955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6262637-ee46-4f9e-a375-3e5125651257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:54.532553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6262637-ee46-4f9e-a375-3e5125651257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:54.644572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:54.647486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6262637-ee46-4f9e-a375-3e5125651257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:21:54.648958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6262637-ee46-4f9e-a375-3e5125651257 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:21:54.667664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 667/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:21:56.840810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da560bba-76a7-4576-8b9e-1630ff6e2854 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:56.841314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da560bba-76a7-4576-8b9e-1630ff6e2854 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:56.841314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da560bba-76a7-4576-8b9e-1630ff6e2854 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:56.843097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 662/1329] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:21:56.849155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e7b5-2650-45c2-85bc-347f6c10e8e1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:56.849586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e7b5-2650-45c2-85bc-347f6c10e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:56.849697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e7b5-2650-45c2-85bc-347f6c10e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:56.937042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ce79e7b5-2650-45c2-85bc-347f6c10e8e1 None None] MFA Rules not processed for user `d0e577d4147e404ca97862a7fb601d97`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:21:56.938214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ce79e7b5-2650-45c2-85bc-347f6c10e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:57.042046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 668/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:21:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:21:57.322002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da560bba-76a7-4576-8b9e-1630ff6e2854 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:21:57.323594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-da560bba-76a7-4576-8b9e-1630ff6e2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:57.356691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:57.431760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da560bba-76a7-4576-8b9e-1630ff6e2854 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:21:57.507126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf9bd6-210a-49f2-bb34-5492bcbd7b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:21:57.507646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9bd6-210a-49f2-bb34-5492bcbd7b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:21:57.507935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9bd6-210a-49f2-bb34-5492bcbd7b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:21:57.508207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9bd6-210a-49f2-bb34-5492bcbd7b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:21:57.509792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5bbf9bd6-210a-49f2-bb34-5492bcbd7b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:21:57.606273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:21:57.642755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf9bd6-210a-49f2-bb34-5492bcbd7b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:21:57.644302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf9bd6-210a-49f2-bb34-5492bcbd7b35 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:21:57.663393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 663/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:21:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:00.032244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7f6c-b421-4825-ab92-77d7812e627b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:00.032753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7f6c-b421-4825-ab92-77d7812e627b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:00.032753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7f6c-b421-4825-ab92-77d7812e627b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:00.034405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 669/1332] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:00.039973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d4f34-f007-4352-b3e2-af38c07abc62 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:00.040444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d4f34-f007-4352-b3e2-af38c07abc62 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:00.040550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d4f34-f007-4352-b3e2-af38c07abc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:00.107769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-769d4f34-f007-4352-b3e2-af38c07abc62 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:00.108989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-769d4f34-f007-4352-b3e2-af38c07abc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:00.207020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 664/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:00.485824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7f6c-b421-4825-ab92-77d7812e627b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:00.488322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-68fc7f6c-b421-4825-ab92-77d7812e627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:00.567452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:00.607149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7f6c-b421-4825-ab92-77d7812e627b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:00.685061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65960dde-996b-4cf7-be20-c92bb99a0a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:00.685671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65960dde-996b-4cf7-be20-c92bb99a0a59 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:00.685942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65960dde-996b-4cf7-be20-c92bb99a0a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:00.686207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65960dde-996b-4cf7-be20-c92bb99a0a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:00.687825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-65960dde-996b-4cf7-be20-c92bb99a0a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:00.800697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65960dde-996b-4cf7-be20-c92bb99a0a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:00.802046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65960dde-996b-4cf7-be20-c92bb99a0a59 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:00.811921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:00.820226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 670/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:02.980731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792667c-8954-4326-bd2f-c815f3304496 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:02.981584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792667c-8954-4326-bd2f-c815f3304496 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:02.981584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792667c-8954-4326-bd2f-c815f3304496 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:02.983638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 665/1335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:02.989372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a067a2f-8dde-4dd5-9cbf-1c72ace4f35a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:02.989791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a067a2f-8dde-4dd5-9cbf-1c72ace4f35a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:02.989917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a067a2f-8dde-4dd5-9cbf-1c72ace4f35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:03.061775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0a067a2f-8dde-4dd5-9cbf-1c72ace4f35a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:03.063315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0a067a2f-8dde-4dd5-9cbf-1c72ace4f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:03.165591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 671/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:03.459487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792667c-8954-4326-bd2f-c815f3304496 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:03.461962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8792667c-8954-4326-bd2f-c815f3304496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:03.514921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:03.586363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792667c-8954-4326-bd2f-c815f3304496 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:03.667063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bb216-4403-4a81-b925-3a601a41e8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:03.667679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bb216-4403-4a81-b925-3a601a41e8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:03.667954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bb216-4403-4a81-b925-3a601a41e8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:03.668227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bb216-4403-4a81-b925-3a601a41e8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:03.669821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-205bb216-4403-4a81-b925-3a601a41e8b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:03.756960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:03.783698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bb216-4403-4a81-b925-3a601a41e8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:03.785186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bb216-4403-4a81-b925-3a601a41e8b6 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:03.805848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 666/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:06.263194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932871d-05f1-486e-a803-f25721757133 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:06.263865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932871d-05f1-486e-a803-f25721757133 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:06.263865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932871d-05f1-486e-a803-f25721757133 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:06.265115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 672/1338] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:06.270741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b38f6-e918-4ac6-a3d4-7f8099a38249 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:06.271248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b38f6-e918-4ac6-a3d4-7f8099a38249 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:06.271368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b38f6-e918-4ac6-a3d4-7f8099a38249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:06.340057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-665b38f6-e918-4ac6-a3d4-7f8099a38249 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:06.341305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-665b38f6-e918-4ac6-a3d4-7f8099a38249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:06.453587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 667/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:06.736053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932871d-05f1-486e-a803-f25721757133 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:06.737731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7932871d-05f1-486e-a803-f25721757133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:06.816879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:06.846241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932871d-05f1-486e-a803-f25721757133 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:06.940427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb18f8-9cce-4237-84d7-bb7fc8965033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:06.941248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb18f8-9cce-4237-84d7-bb7fc8965033 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:06.941545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb18f8-9cce-4237-84d7-bb7fc8965033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:06.941816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb18f8-9cce-4237-84d7-bb7fc8965033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:06.944433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-58cb18f8-9cce-4237-84d7-bb7fc8965033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:07.062855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb18f8-9cce-4237-84d7-bb7fc8965033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:07.064286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb18f8-9cce-4237-84d7-bb7fc8965033 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:07.083489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 673/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:11.249779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818160f-9db7-418a-9d4f-a8b099e3e8b0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:11.249779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818160f-9db7-418a-9d4f-a8b099e3e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:11.250285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818160f-9db7-418a-9d4f-a8b099e3e8b0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:11.255258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 668/1341] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:11.256888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b2d2-3a6d-4b1e-8882-f39228883e18 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:11.257301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b2d2-3a6d-4b1e-8882-f39228883e18 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:11.257478 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b2d2-3a6d-4b1e-8882-f39228883e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:11.263440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:11.329294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-bf32b2d2-3a6d-4b1e-8882-f39228883e18 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:11.330520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bf32b2d2-3a6d-4b1e-8882-f39228883e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:11.437199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 674/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:11.714587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818160f-9db7-418a-9d4f-a8b099e3e8b0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:11.716185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d818160f-9db7-418a-9d4f-a8b099e3e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:11.766954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:11.825162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818160f-9db7-418a-9d4f-a8b099e3e8b0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:11.903107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80996909-269a-4fe4-8b2b-3e5dd7afc738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:11.903674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996909-269a-4fe4-8b2b-3e5dd7afc738 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:11.903916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996909-269a-4fe4-8b2b-3e5dd7afc738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:11.904183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996909-269a-4fe4-8b2b-3e5dd7afc738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:11.905784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-80996909-269a-4fe4-8b2b-3e5dd7afc738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:12.001234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:12.019078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80996909-269a-4fe4-8b2b-3e5dd7afc738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:12.020575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80996909-269a-4fe4-8b2b-3e5dd7afc738 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:12.038791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 669/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:14.739580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af916-0493-4066-b33d-3c8f27f679e3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:14.740174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af916-0493-4066-b33d-3c8f27f679e3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:14.740174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af916-0493-4066-b33d-3c8f27f679e3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:14.741491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 675/1344] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:14.746946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b274391-6925-4b74-bee8-df866f1cda94 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:14.747394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b274391-6925-4b74-bee8-df866f1cda94 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:14.747509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b274391-6925-4b74-bee8-df866f1cda94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:14.813649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6b274391-6925-4b74-bee8-df866f1cda94 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:14.814864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6b274391-6925-4b74-bee8-df866f1cda94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:14.914623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 670/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:15.188377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af916-0493-4066-b33d-3c8f27f679e3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:15.189923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d09af916-0493-4066-b33d-3c8f27f679e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:15.279876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:15.297268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af916-0493-4066-b33d-3c8f27f679e3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:15.381140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ec91-1c7c-4f22-b2e7-2c9af1b82aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:15.381758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ec91-1c7c-4f22-b2e7-2c9af1b82aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:15.382080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ec91-1c7c-4f22-b2e7-2c9af1b82aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:15.382343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ec91-1c7c-4f22-b2e7-2c9af1b82aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:15.384054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8963ec91-1c7c-4f22-b2e7-2c9af1b82aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:15.494297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963ec91-1c7c-4f22-b2e7-2c9af1b82aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:15.495680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963ec91-1c7c-4f22-b2e7-2c9af1b82aa0 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:15.514371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 676/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:19.594301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1b1c-42d0-4967-8607-a8bdabbd5a42 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:19.594845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1b1c-42d0-4967-8607-a8bdabbd5a42 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:19.594845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1b1c-42d0-4967-8607-a8bdabbd5a42 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:19.596296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 671/1347] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:19.602137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a15ba-532f-4524-8764-b42f97c094be None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:19.602618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a15ba-532f-4524-8764-b42f97c094be None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:19.602714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a15ba-532f-4524-8764-b42f97c094be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:19.619889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:19.673712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-743a15ba-532f-4524-8764-b42f97c094be None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:19.674948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-743a15ba-532f-4524-8764-b42f97c094be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:19.773505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 677/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:20.052676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1b1c-42d0-4967-8607-a8bdabbd5a42 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:20.054216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d3dc1b1c-42d0-4967-8607-a8bdabbd5a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:20.114373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:20.162410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1b1c-42d0-4967-8607-a8bdabbd5a42 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:20.239258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f600bd-53f2-4458-a2e8-e2a6c2f452ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:20.239877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f600bd-53f2-4458-a2e8-e2a6c2f452ae service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:20.240131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f600bd-53f2-4458-a2e8-e2a6c2f452ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:20.240415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f600bd-53f2-4458-a2e8-e2a6c2f452ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:20.242029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f3f600bd-53f2-4458-a2e8-e2a6c2f452ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:20.352494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:20.356536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f600bd-53f2-4458-a2e8-e2a6c2f452ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:20.358235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f600bd-53f2-4458-a2e8-e2a6c2f452ae service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:20.376546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 672/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:25.372784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cda6f-bcdc-43c0-9c48-8292024b3e31 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:25.373339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cda6f-bcdc-43c0-9c48-8292024b3e31 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:25.373339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cda6f-bcdc-43c0-9c48-8292024b3e31 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:25.380538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 678/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:22:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:25.386636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c8de4-4323-4621-b05d-b47fa6eaabb4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:25.387238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c8de4-4323-4621-b05d-b47fa6eaabb4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:25.387340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c8de4-4323-4621-b05d-b47fa6eaabb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:25.467789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-103c8de4-4323-4621-b05d-b47fa6eaabb4 None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:25.469160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-103c8de4-4323-4621-b05d-b47fa6eaabb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:25.585391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 673/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:22:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:29.531305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef3de-7a82-44f0-94ae-2a36a0246882 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:29.531856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef3de-7a82-44f0-94ae-2a36a0246882 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:29.531856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef3de-7a82-44f0-94ae-2a36a0246882 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:29.533183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 679/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:29.539126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8b93-3b74-4d11-b06a-42cd871051c3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:29.540406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8b93-3b74-4d11-b06a-42cd871051c3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:29.540931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8b93-3b74-4d11-b06a-42cd871051c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:29.608737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:29.639831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bf0a8b93-3b74-4d11-b06a-42cd871051c3 None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:29.641163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bf0a8b93-3b74-4d11-b06a-42cd871051c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:29.751674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 674/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:22:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:29.771761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=59 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:31.145900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c12540-5616-491e-a4d3-d98ed8c81fb2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:31.146544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c12540-5616-491e-a4d3-d98ed8c81fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:31.146544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c12540-5616-491e-a4d3-d98ed8c81fb2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:31.148088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 680/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:31.153916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96f25-79a7-462e-8897-5b4ee0075309 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:31.154709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96f25-79a7-462e-8897-5b4ee0075309 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:31.155031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96f25-79a7-462e-8897-5b4ee0075309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:31.234520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-11e96f25-79a7-462e-8897-5b4ee0075309 None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:31.235774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-11e96f25-79a7-462e-8897-5b4ee0075309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:31.279446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:31.346556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 675/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:22:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:34.915054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc7b7-dda7-48a9-95ae-c0f3fd3ea262 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:34.915565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc7b7-dda7-48a9-95ae-c0f3fd3ea262 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:34.915565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc7b7-dda7-48a9-95ae-c0f3fd3ea262 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:34.916839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 681/1356] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:34.922368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063989-52fa-4d4b-a70d-dcf0badb7673 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:34.922802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063989-52fa-4d4b-a70d-dcf0badb7673 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:34.923035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063989-52fa-4d4b-a70d-dcf0badb7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:34.991819 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-93063989-52fa-4d4b-a70d-dcf0badb7673 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:34.993047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-93063989-52fa-4d4b-a70d-dcf0badb7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:35.094879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 676/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:22:35.391617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614bfee-5049-48ed-be93-818816e778f6 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:35.392338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614bfee-5049-48ed-be93-818816e778f6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:35.393106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614bfee-5049-48ed-be93-818816e778f6 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:35.396980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 682/1358] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 15 07:22:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:35.404865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa5a56-4271-414f-8b41-6072bc4a3503 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:35.405164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa5a56-4271-414f-8b41-6072bc4a3503 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:35.405450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa5a56-4271-414f-8b41-6072bc4a3503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:35.421655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:35.485515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-5aaa5a56-4271-414f-8b41-6072bc4a3503 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:35.486926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5aaa5a56-4271-414f-8b41-6072bc4a3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:35.607717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 677/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 15 07:22:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:35.620125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614bfee-5049-48ed-be93-818816e778f6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:35.621912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4614bfee-5049-48ed-be93-818816e778f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:35.783891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614bfee-5049-48ed-be93-818816e778f6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:35.864594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:35.907810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981ace1-205d-41f1-ac3b-0637612f4ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:35.908758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981ace1-205d-41f1-ac3b-0637612f4ba2 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:35.909140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981ace1-205d-41f1-ac3b-0637612f4ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:35.909596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981ace1-205d-41f1-ac3b-0637612f4ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:35.911470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e981ace1-205d-41f1-ac3b-0637612f4ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:36.013097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981ace1-205d-41f1-ac3b-0637612f4ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:36.015885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981ace1-205d-41f1-ac3b-0637612f4ba2 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:36.047026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 683/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:38.430972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34b175-b989-4d75-8fdb-593ca047a5d6 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:38.431483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34b175-b989-4d75-8fdb-593ca047a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:38.431483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34b175-b989-4d75-8fdb-593ca047a5d6 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:38.433130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 678/1361] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:38.438462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d115-6541-49d4-bae6-40e930a626c1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:38.438462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d115-6541-49d4-bae6-40e930a626c1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:38.439419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d115-6541-49d4-bae6-40e930a626c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:38.506774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1a76d115-6541-49d4-bae6-40e930a626c1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:38.508022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1a76d115-6541-49d4-bae6-40e930a626c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:38.547180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:38.630849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 684/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:38.906506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34b175-b989-4d75-8fdb-593ca047a5d6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:38.908100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7b34b175-b989-4d75-8fdb-593ca047a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:38.984267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:39.092862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34b175-b989-4d75-8fdb-593ca047a5d6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:39.232669 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfbeab-d285-4dbb-9715-ded95ab17426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:39.233306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfbeab-d285-4dbb-9715-ded95ab17426 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:39.233586 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfbeab-d285-4dbb-9715-ded95ab17426 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:39.233859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfbeab-d285-4dbb-9715-ded95ab17426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:39.235549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3edfbeab-d285-4dbb-9715-ded95ab17426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:39.258949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:39.329448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfbeab-d285-4dbb-9715-ded95ab17426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:39.331152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfbeab-d285-4dbb-9715-ded95ab17426 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:39.349699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 679/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:41.805721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5c8e-6368-4b69-b54f-f4d2d11db534 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:41.806256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5c8e-6368-4b69-b54f-f4d2d11db534 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:41.806377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5c8e-6368-4b69-b54f-f4d2d11db534 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:41.807943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 685/1364] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:41.813420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470904c0-663f-41f5-9154-c73a3d774df2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:41.813898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470904c0-663f-41f5-9154-c73a3d774df2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:41.814125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470904c0-663f-41f5-9154-c73a3d774df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:41.882575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-470904c0-663f-41f5-9154-c73a3d774df2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:41.883985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-470904c0-663f-41f5-9154-c73a3d774df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:41.984359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:41.995002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 680/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:42.276388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdf23-8c42-47fd-b3f5-7842fe84dcab None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:42.276687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdf23-8c42-47fd-b3f5-7842fe84dcab None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:42.276937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cdf23-8c42-47fd-b3f5-7842fe84dcab None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:42.278468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 686/1366] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 15 07:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:42.283702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e7f4-7eff-4d41-975e-e4c78386e0e9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:42.284090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e7f4-7eff-4d41-975e-e4c78386e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:42.284468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e7f4-7eff-4d41-975e-e4c78386e0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:42.366706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-88b0e7f4-7eff-4d41-975e-e4c78386e0e9 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:42.368135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-88b0e7f4-7eff-4d41-975e-e4c78386e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:42.492067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 681/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 15 07:22:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:42.500970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cdf23-8c42-47fd-b3f5-7842fe84dcab None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:42.503038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4d5cdf23-8c42-47fd-b3f5-7842fe84dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:42.674705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cdf23-8c42-47fd-b3f5-7842fe84dcab None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:42.696659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:42.803563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac519437-72c2-4c5c-9329-4f2f4e641f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:42.804365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac519437-72c2-4c5c-9329-4f2f4e641f85 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:42.804722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac519437-72c2-4c5c-9329-4f2f4e641f85 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:42.805101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac519437-72c2-4c5c-9329-4f2f4e641f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:42.806952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ac519437-72c2-4c5c-9329-4f2f4e641f85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:42.902481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac519437-72c2-4c5c-9329-4f2f4e641f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:42.904054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac519437-72c2-4c5c-9329-4f2f4e641f85 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:42.925979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 687/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:43.018700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c549c-5c5e-4786-ba64-7ba7b62a1f57 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:43.019269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c549c-5c5e-4786-ba64-7ba7b62a1f57 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:43.019269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c549c-5c5e-4786-ba64-7ba7b62a1f57 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:43.020967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 682/1369] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:43.027748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08e89d-2bb6-4cff-ad56-427ed98ce9ae None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:43.027748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08e89d-2bb6-4cff-ad56-427ed98ce9ae None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:43.027748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08e89d-2bb6-4cff-ad56-427ed98ce9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:43.067689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:43.114054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ab08e89d-2bb6-4cff-ad56-427ed98ce9ae None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:43.115409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ab08e89d-2bb6-4cff-ad56-427ed98ce9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:43.246275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 688/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:22:43.590728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f798-ebed-4db7-ad1d-7b83d78fd49c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:43.590728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f798-ebed-4db7-ad1d-7b83d78fd49c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:43.590728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f798-ebed-4db7-ad1d-7b83d78fd49c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:43.593463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 683/1371] 10.222.0.15 () {54 vars in 964 bytes} [Thu Sep 15 07:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:43.596890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806d3e-8af1-4ff8-b81e-0956c964b9c4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:43.597130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806d3e-8af1-4ff8-b81e-0956c964b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:43.597433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806d3e-8af1-4ff8-b81e-0956c964b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:43.682046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-36806d3e-8af1-4ff8-b81e-0956c964b9c4 None None] MFA Rules not processed for user `2cc638eccee04ac6a71972e255947aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:43.683300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-36806d3e-8af1-4ff8-b81e-0956c964b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:43.733933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:43.765674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 689/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Sep 15 07:22:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:43.773970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f798-ebed-4db7-ad1d-7b83d78fd49c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:43.775543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-df91f798-ebed-4db7-ad1d-7b83d78fd49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:43.833638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:43.891172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f798-ebed-4db7-ad1d-7b83d78fd49c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:43.976354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458d3c0-824f-40e5-97c5-7bd099ad38aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:43.976975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458d3c0-824f-40e5-97c5-7bd099ad38aa service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:43.977250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458d3c0-824f-40e5-97c5-7bd099ad38aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:43.977520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458d3c0-824f-40e5-97c5-7bd099ad38aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:43.979165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5458d3c0-824f-40e5-97c5-7bd099ad38aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:44.084933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:44.099119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458d3c0-824f-40e5-97c5-7bd099ad38aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:44.100763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458d3c0-824f-40e5-97c5-7bd099ad38aa service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:44.120298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 684/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:45.199919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284fe5-6b29-4882-8ba2-f1fb22097d5e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:45.200542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284fe5-6b29-4882-8ba2-f1fb22097d5e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:45.200542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284fe5-6b29-4882-8ba2-f1fb22097d5e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:45.201784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 690/1374] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:45.207395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8425b-ef4c-485f-be28-400ae140627b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:45.207809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8425b-ef4c-485f-be28-400ae140627b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:45.208046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8425b-ef4c-485f-be28-400ae140627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:45.278090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d2f8425b-ef4c-485f-be28-400ae140627b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:45.279364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d2f8425b-ef4c-485f-be28-400ae140627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:45.378892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 685/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:45.668149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74284fe5-6b29-4882-8ba2-f1fb22097d5e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:45.669889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-74284fe5-6b29-4882-8ba2-f1fb22097d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:45.831668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74284fe5-6b29-4882-8ba2-f1fb22097d5e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:45.884923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:45.949507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceea5c7-3a46-4aee-bffe-0be364031dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:45.949507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceea5c7-3a46-4aee-bffe-0be364031dff service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:45.949507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceea5c7-3a46-4aee-bffe-0be364031dff service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:45.949507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceea5c7-3a46-4aee-bffe-0be364031dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:45.951004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cceea5c7-3a46-4aee-bffe-0be364031dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:46.045936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceea5c7-3a46-4aee-bffe-0be364031dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:46.047622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceea5c7-3a46-4aee-bffe-0be364031dff service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:46.069014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 691/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:48.258955 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2ac7-3e8a-4167-bdac-0ed58001d921 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:48.259547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2ac7-3e8a-4167-bdac-0ed58001d921 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:48.259690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2ac7-3e8a-4167-bdac-0ed58001d921 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:48.261126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 686/1377] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:48.266435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d1869-5dc3-4f4e-b9b4-da0236b8e340 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:48.266920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d1869-5dc3-4f4e-b9b4-da0236b8e340 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:48.267021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d1869-5dc3-4f4e-b9b4-da0236b8e340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:48.334220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1d6d1869-5dc3-4f4e-b9b4-da0236b8e340 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:48.335368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1d6d1869-5dc3-4f4e-b9b4-da0236b8e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:48.345182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:48.445777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 692/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:48.727981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2ac7-3e8a-4167-bdac-0ed58001d921 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:48.729505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ae1c2ac7-3e8a-4167-bdac-0ed58001d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:48.793116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:48.882436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2ac7-3e8a-4167-bdac-0ed58001d921 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:48.998691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593e699-1e85-4145-be20-f2d7577a6306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:48.999341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593e699-1e85-4145-be20-f2d7577a6306 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:48.999624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593e699-1e85-4145-be20-f2d7577a6306 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:48.999891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593e699-1e85-4145-be20-f2d7577a6306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:49.001598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3593e699-1e85-4145-be20-f2d7577a6306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:49.020957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:49.095453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593e699-1e85-4145-be20-f2d7577a6306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:49.097126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593e699-1e85-4145-be20-f2d7577a6306 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:49.115720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 687/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:51.298657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ad97a-b6a8-4859-8d67-fc29acf87b92 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:51.299175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ad97a-b6a8-4859-8d67-fc29acf87b92 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:51.299284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ad97a-b6a8-4859-8d67-fc29acf87b92 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:51.300818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 693/1380] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:51.306036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217daa-5cae-4209-9e72-2c1cf23ffd7a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:51.306446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217daa-5cae-4209-9e72-2c1cf23ffd7a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:51.306626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217daa-5cae-4209-9e72-2c1cf23ffd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:51.385049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7f217daa-5cae-4209-9e72-2c1cf23ffd7a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:51.386292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7f217daa-5cae-4209-9e72-2c1cf23ffd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:51.486887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:51.494630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 688/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:51.788309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ad97a-b6a8-4859-8d67-fc29acf87b92 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:51.790492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-aa8ad97a-b6a8-4859-8d67-fc29acf87b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:51.961665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:51.974480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ad97a-b6a8-4859-8d67-fc29acf87b92 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:52.090994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c96d49-b83d-4591-9d45-a3f23eb5f22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:52.091974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96d49-b83d-4591-9d45-a3f23eb5f22d service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:52.092252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96d49-b83d-4591-9d45-a3f23eb5f22d service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:52.092531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c96d49-b83d-4591-9d45-a3f23eb5f22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:52.094199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-75c96d49-b83d-4591-9d45-a3f23eb5f22d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:52.203939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c96d49-b83d-4591-9d45-a3f23eb5f22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:52.206273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c96d49-b83d-4591-9d45-a3f23eb5f22d service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:52.219344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:52.231523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 694/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:54.458113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531e56-e730-4180-9522-9eb1cfb433c0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:54.458677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531e56-e730-4180-9522-9eb1cfb433c0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:54.458677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531e56-e730-4180-9522-9eb1cfb433c0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:54.460105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 689/1383] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:54.465983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4745-9b42-4c3e-ae7a-e3a8df7708f1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:54.466750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4745-9b42-4c3e-ae7a-e3a8df7708f1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:54.466870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e4745-9b42-4c3e-ae7a-e3a8df7708f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:54.546312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0a1e4745-9b42-4c3e-ae7a-e3a8df7708f1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:54.548041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0a1e4745-9b42-4c3e-ae7a-e3a8df7708f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:54.676511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 695/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:22:54.967553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d531e56-e730-4180-9522-9eb1cfb433c0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:54.969699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2d531e56-e730-4180-9522-9eb1cfb433c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:55.127297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d531e56-e730-4180-9522-9eb1cfb433c0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:55.205026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:55.263073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0c179-91f1-419d-90e6-9eaa26ed7a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:55.263822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c179-91f1-419d-90e6-9eaa26ed7a4e service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:55.264148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c179-91f1-419d-90e6-9eaa26ed7a4e service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:55.264463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0c179-91f1-419d-90e6-9eaa26ed7a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:55.266488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0bf0c179-91f1-419d-90e6-9eaa26ed7a4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:55.380947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0c179-91f1-419d-90e6-9eaa26ed7a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:55.382992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0c179-91f1-419d-90e6-9eaa26ed7a4e service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:55.405572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 690/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:57.941850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446dcdb-c425-4263-b24f-dd87f10ccb6c None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:57.942406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446dcdb-c425-4263-b24f-dd87f10ccb6c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:57.942406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446dcdb-c425-4263-b24f-dd87f10ccb6c None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:57.943839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 696/1386] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:57.949124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac6d4-ad8b-4ae1-ae28-0b67b123a85a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:57.949629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac6d4-ad8b-4ae1-ae28-0b67b123a85a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:57.949629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac6d4-ad8b-4ae1-ae28-0b67b123a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:58.027098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b3bac6d4-ad8b-4ae1-ae28-0b67b123a85a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:58.028291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b3bac6d4-ad8b-4ae1-ae28-0b67b123a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:58.062740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:58.128177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 691/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:58.411845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446dcdb-c425-4263-b24f-dd87f10ccb6c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:58.413390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6446dcdb-c425-4263-b24f-dd87f10ccb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:58.493918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:58.566683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446dcdb-c425-4263-b24f-dd87f10ccb6c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:22:58.696926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874da024-1dd2-43ff-a590-e70517c68c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:22:58.697462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874da024-1dd2-43ff-a590-e70517c68c74 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:58.697745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874da024-1dd2-43ff-a590-e70517c68c74 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:58.698009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874da024-1dd2-43ff-a590-e70517c68c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:58.699667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-874da024-1dd2-43ff-a590-e70517c68c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:58.740900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:58.794425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874da024-1dd2-43ff-a590-e70517c68c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:22:58.796098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874da024-1dd2-43ff-a590-e70517c68c74 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:22:58.814840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 697/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:22:59.233265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68616e8e-b31d-4af5-b62e-d578d623c02e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:59.233848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68616e8e-b31d-4af5-b62e-d578d623c02e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:59.233848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68616e8e-b31d-4af5-b62e-d578d623c02e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:59.235325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 692/1389] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:59.240667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca104-0c6a-44c6-a244-6591c99eedf8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:59.241099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca104-0c6a-44c6-a244-6591c99eedf8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:59.241188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca104-0c6a-44c6-a244-6591c99eedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:59.313731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-697ca104-0c6a-44c6-a244-6591c99eedf8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:59.315028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-697ca104-0c6a-44c6-a244-6591c99eedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:59.430865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 698/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:59.722134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53993f-aeb1-4530-baad-b772b33513ae None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:59.722448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53993f-aeb1-4530-baad-b772b33513ae None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:59.722717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53993f-aeb1-4530-baad-b772b33513ae None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:59.724194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 693/1391] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 15 07:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:22:59.730422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f8d77-e56e-46b5-9302-a379c7587a27 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:22:59.730686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f8d77-e56e-46b5-9302-a379c7587a27 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:22:59.730955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f8d77-e56e-46b5-9302-a379c7587a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:22:59.747121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:22:59.808297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b04f8d77-e56e-46b5-9302-a379c7587a27 None None] MFA Rules not processed for user `e870f9d558024213a6db2c32a8d6de24`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:22:59.809541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b04f8d77-e56e-46b5-9302-a379c7587a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:22:59.889349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 699/1392] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 15 07:22:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:22:59.898583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53993f-aeb1-4530-baad-b772b33513ae None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:22:59.900153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1b53993f-aeb1-4530-baad-b772b33513ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:00.005140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53993f-aeb1-4530-baad-b772b33513ae None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:00.066675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:00.082116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e14eb3-9b6b-44cc-bf31-89e1ebe4e13a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:00.082732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e14eb3-9b6b-44cc-bf31-89e1ebe4e13a service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:00.083070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e14eb3-9b6b-44cc-bf31-89e1ebe4e13a service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:00.083317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e14eb3-9b6b-44cc-bf31-89e1ebe4e13a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:00.084904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e5e14eb3-9b6b-44cc-bf31-89e1ebe4e13a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:00.194529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e14eb3-9b6b-44cc-bf31-89e1ebe4e13a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:00.195921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e14eb3-9b6b-44cc-bf31-89e1ebe4e13a service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:00.214392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 694/1393] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:00.975315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461811-fb20-4905-94d5-26b3fa4928ad None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:00.975839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461811-fb20-4905-94d5-26b3fa4928ad None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:00.975839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461811-fb20-4905-94d5-26b3fa4928ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:00.984174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95150f-cb1d-4f39-b721-73d7b93e933b None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:00.984624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95150f-cb1d-4f39-b721-73d7b93e933b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:00.984738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95150f-cb1d-4f39-b721-73d7b93e933b None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:00.986058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 695/1394] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:23:00.991391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cdb4b-9af3-409d-96e3-27643e948910 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:00.991672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cdb4b-9af3-409d-96e3-27643e948910 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:00.991946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cdb4b-9af3-409d-96e3-27643e948910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:01.047053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-54461811-fb20-4905-94d5-26b3fa4928ad None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:01.048299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-54461811-fb20-4905-94d5-26b3fa4928ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:01.058771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a36cdb4b-9af3-409d-96e3-27643e948910 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:01.059968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a36cdb4b-9af3-409d-96e3-27643e948910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:01.109592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:01.110177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:01.145949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 700/1395] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:23:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:01.188689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 696/1396] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:23:01.193025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd48d7-e1ee-4d44-83cf-3ba133bf4ce8 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:01.193311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd48d7-e1ee-4d44-83cf-3ba133bf4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:01.193718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd48d7-e1ee-4d44-83cf-3ba133bf4ce8 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:01.195115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 701/1397] 10.222.0.15 () {54 vars in 943 bytes} [Thu Sep 15 07:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:01.201912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:01.202307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:01.202648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:01.282135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] MFA Rules not processed for user `263fc62721954c23b0357d9e45447713`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:01.283429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:01.397559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 697/1398] 10.222.0.15 () {58 vars in 1040 bytes} [Thu Sep 15 07:23:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:23:01.407359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd48d7-e1ee-4d44-83cf-3ba133bf4ce8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:01.408938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-14bd48d7-e1ee-4d44-83cf-3ba133bf4ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:01.474275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:01.475530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:01.478647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:01.547758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd48d7-e1ee-4d44-83cf-3ba133bf4ce8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:01.572703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6b25-f009-4fac-9648-b10c675f9b37 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:01.608247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:01.668799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8f151-da34-410f-9c86-16f90fde4b05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:01.669334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f151-da34-410f-9c86-16f90fde4b05 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:01.669608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f151-da34-410f-9c86-16f90fde4b05 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:01.669874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f151-da34-410f-9c86-16f90fde4b05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:01.671689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cfe8f151-da34-410f-9c86-16f90fde4b05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:01.702164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21850f-df99-4461-9e63-906543e8c87f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:01.702755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21850f-df99-4461-9e63-906543e8c87f service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:01.703094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21850f-df99-4461-9e63-906543e8c87f service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:01.703361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21850f-df99-4461-9e63-906543e8c87f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:01.704961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ce21850f-df99-4461-9e63-906543e8c87f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:01.717921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:01.757128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8f151-da34-410f-9c86-16f90fde4b05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:01.758887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8f151-da34-410f-9c86-16f90fde4b05 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:01.767106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 702/1399] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:23:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:23:01.800292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21850f-df99-4461-9e63-906543e8c87f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:01.802047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21850f-df99-4461-9e63-906543e8c87f service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:01.821321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 698/1400] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:04.015801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec86f9-ce3f-4578-bb4d-30ee1d131f5d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:04.016348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec86f9-ce3f-4578-bb4d-30ee1d131f5d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:04.016348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec86f9-ce3f-4578-bb4d-30ee1d131f5d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:04.018083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 703/1401] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:04.023410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717aaa-7de6-4379-a7ac-1f93089ee3f9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:04.023837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717aaa-7de6-4379-a7ac-1f93089ee3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:04.023996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717aaa-7de6-4379-a7ac-1f93089ee3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:04.096305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bd717aaa-7de6-4379-a7ac-1f93089ee3f9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:04.097834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bd717aaa-7de6-4379-a7ac-1f93089ee3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:04.194264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:04.206465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 699/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:04.497485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec86f9-ce3f-4578-bb4d-30ee1d131f5d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:04.499158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-75ec86f9-ce3f-4578-bb4d-30ee1d131f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:04.593479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:04.662634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec86f9-ce3f-4578-bb4d-30ee1d131f5d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:04.783597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552983-6625-47c2-b738-363c3e9fdcca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:04.784139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552983-6625-47c2-b738-363c3e9fdcca service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:04.784413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552983-6625-47c2-b738-363c3e9fdcca service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:04.784684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552983-6625-47c2-b738-363c3e9fdcca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:04.786316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c5552983-6625-47c2-b738-363c3e9fdcca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:04.852734 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:04.890911 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5552983-6625-47c2-b738-363c3e9fdcca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:04.892530 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5552983-6625-47c2-b738-363c3e9fdcca service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:04.914992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 704/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:07.104951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9358-6e94-4a50-98a2-3e27c2faa2d4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:07.106060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9358-6e94-4a50-98a2-3e27c2faa2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:07.106425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9358-6e94-4a50-98a2-3e27c2faa2d4 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:07.109870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 700/1404] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:23:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:07.115582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91664ba1-592f-4064-a530-2818490b4019 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:07.116398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91664ba1-592f-4064-a530-2818490b4019 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:07.116740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91664ba1-592f-4064-a530-2818490b4019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:07.190292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-91664ba1-592f-4064-a530-2818490b4019 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:07.191584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-91664ba1-592f-4064-a530-2818490b4019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:07.293563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 705/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:07.579549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f9358-6e94-4a50-98a2-3e27c2faa2d4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:07.581208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d53f9358-6e94-4a50-98a2-3e27c2faa2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:07.756833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f9358-6e94-4a50-98a2-3e27c2faa2d4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:07.826207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:07.882286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3b02-7091-41c0-9cb1-83e231050b54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:07.882970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3b02-7091-41c0-9cb1-83e231050b54 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:07.883305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3b02-7091-41c0-9cb1-83e231050b54 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:07.883575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3b02-7091-41c0-9cb1-83e231050b54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:07.885195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-96dd3b02-7091-41c0-9cb1-83e231050b54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:07.982160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3b02-7091-41c0-9cb1-83e231050b54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:07.983838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3b02-7091-41c0-9cb1-83e231050b54 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:08.005973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 701/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:10.209648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c7a1-5374-4157-8dc6-d7f9c1615a0d None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:10.210216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c7a1-5374-4157-8dc6-d7f9c1615a0d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:10.210216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c7a1-5374-4157-8dc6-d7f9c1615a0d None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:10.211623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 706/1407] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:10.217420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e95a0-ee59-42f3-bba4-850be5e0a30e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:10.218238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e95a0-ee59-42f3-bba4-850be5e0a30e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:10.218745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e95a0-ee59-42f3-bba4-850be5e0a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:10.290927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fe6e95a0-ee59-42f3-bba4-850be5e0a30e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:10.292146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fe6e95a0-ee59-42f3-bba4-850be5e0a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:10.322209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:10.397401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 702/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:10.682928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67c7a1-5374-4157-8dc6-d7f9c1615a0d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:10.684500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7c67c7a1-5374-4157-8dc6-d7f9c1615a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:10.724724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:10.845321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67c7a1-5374-4157-8dc6-d7f9c1615a0d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:10.971786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:10.977691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbae0f-22fb-4d45-b6f9-0b279fdc8320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:10.978311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbae0f-22fb-4d45-b6f9-0b279fdc8320 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:10.978588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbae0f-22fb-4d45-b6f9-0b279fdc8320 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:10.978886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbae0f-22fb-4d45-b6f9-0b279fdc8320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:10.982712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bdcbae0f-22fb-4d45-b6f9-0b279fdc8320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:11.081111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbae0f-22fb-4d45-b6f9-0b279fdc8320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:11.082739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbae0f-22fb-4d45-b6f9-0b279fdc8320 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:11.102159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 707/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:20.396000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=31 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:21.099806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=47 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:24.196123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73bdba-50a8-48b8-8671-e670e0846962 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:24.196714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73bdba-50a8-48b8-8671-e670e0846962 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:24.196714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73bdba-50a8-48b8-8671-e670e0846962 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:24.198049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 703/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu Sep 15 07:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:24.203629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd28463-f0dd-4764-8492-2925bceac35d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:24.204086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd28463-f0dd-4764-8492-2925bceac35d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:24.204195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd28463-f0dd-4764-8492-2925bceac35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:24.292163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fcd28463-f0dd-4764-8492-2925bceac35d None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:24.293370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fcd28463-f0dd-4764-8492-2925bceac35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:24.405905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 708/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Sep 15 07:23:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:23:24.421937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289b32-2e2e-4046-8934-1a538382a89c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:24.422222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289b32-2e2e-4046-8934-1a538382a89c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:24.422499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289b32-2e2e-4046-8934-1a538382a89c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:24.423875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 704/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu Sep 15 07:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:24.428927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaaaad-5e98-42e0-b050-455a94b1cc5c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:24.429216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaaaad-5e98-42e0-b050-455a94b1cc5c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:24.429524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaaaad-5e98-42e0-b050-455a94b1cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:24.513912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:24.517026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-44eaaaad-5e98-42e0-b050-455a94b1cc5c None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:24.518621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-44eaaaad-5e98-42e0-b050-455a94b1cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:24.651313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 709/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Sep 15 07:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:27.235574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918cd83-482d-48cf-9ab9-c0eac18898aa None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:27.236437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918cd83-482d-48cf-9ab9-c0eac18898aa None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:27.236588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918cd83-482d-48cf-9ab9-c0eac18898aa None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:27.238623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:23:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:27.245250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cebb-ea7a-4c14-9ba0-4c1536873b9c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:27.245714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cebb-ea7a-4c14-9ba0-4c1536873b9c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:27.245825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cebb-ea7a-4c14-9ba0-4c1536873b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:27.327587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a417cebb-ea7a-4c14-9ba0-4c1536873b9c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:27.328815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a417cebb-ea7a-4c14-9ba0-4c1536873b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:27.387252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:27.430144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:27.719154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918cd83-482d-48cf-9ab9-c0eac18898aa None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:27.720844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a918cd83-482d-48cf-9ab9-c0eac18898aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:27.891042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918cd83-482d-48cf-9ab9-c0eac18898aa None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:27.966748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:28.008327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb29db3-d4f9-455b-94f8-b19a15579758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:28.008931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb29db3-d4f9-455b-94f8-b19a15579758 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:28.009205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb29db3-d4f9-455b-94f8-b19a15579758 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:28.009477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb29db3-d4f9-455b-94f8-b19a15579758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:28.011114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5eb29db3-d4f9-455b-94f8-b19a15579758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:28.111946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb29db3-d4f9-455b-94f8-b19a15579758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:28.113622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb29db3-d4f9-455b-94f8-b19a15579758 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:28.133168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 706/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:29.271446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4021e5-13aa-4fd5-8c99-36eef9707703 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:29.272048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4021e5-13aa-4fd5-8c99-36eef9707703 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:29.272048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4021e5-13aa-4fd5-8c99-36eef9707703 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:29.274132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:29.280471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2828-34d6-463d-8273-aa5958e132c2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:29.280934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2828-34d6-463d-8273-aa5958e132c2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:29.281057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2828-34d6-463d-8273-aa5958e132c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:29.358540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-52ce2828-34d6-463d-8273-aa5958e132c2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:29.359755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-52ce2828-34d6-463d-8273-aa5958e132c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:29.388909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:29.483991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:29.632430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4021e5-13aa-4fd5-8c99-36eef9707703 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:29.633970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fe4021e5-13aa-4fd5-8c99-36eef9707703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:29.791700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4021e5-13aa-4fd5-8c99-36eef9707703 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:29.844164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:29.919044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31455106-7697-46d4-ac17-d23aeb272e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:29.919946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455106-7697-46d4-ac17-d23aeb272e50 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:29.920350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455106-7697-46d4-ac17-d23aeb272e50 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:29.920774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455106-7697-46d4-ac17-d23aeb272e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:29.923407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-31455106-7697-46d4-ac17-d23aeb272e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:30.016858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31455106-7697-46d4-ac17-d23aeb272e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:30.018467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31455106-7697-46d4-ac17-d23aeb272e50 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:30.036805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 712/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:31.188296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427835-34a6-4ccb-ae22-b7890006754c None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:31.188875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427835-34a6-4ccb-ae22-b7890006754c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:31.188875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427835-34a6-4ccb-ae22-b7890006754c None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:31.190223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:31.197799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd59c4-df10-41ec-970d-e418424d107f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:31.198287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd59c4-df10-41ec-970d-e418424d107f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:31.198388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd59c4-df10-41ec-970d-e418424d107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:31.262084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:31.284185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e2fd59c4-df10-41ec-970d-e418424d107f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:31.285529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e2fd59c4-df10-41ec-970d-e418424d107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:31.386432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:31.542232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427835-34a6-4ccb-ae22-b7890006754c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:31.543702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a6427835-34a6-4ccb-ae22-b7890006754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:31.711592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427835-34a6-4ccb-ae22-b7890006754c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:31.724780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:31.830675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4b703-2035-4dcc-be91-266e752d43d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:31.831229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4b703-2035-4dcc-be91-266e752d43d8 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:31.831497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4b703-2035-4dcc-be91-266e752d43d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:31.831929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4b703-2035-4dcc-be91-266e752d43d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:31.833595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f3f4b703-2035-4dcc-be91-266e752d43d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:31.948066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4b703-2035-4dcc-be91-266e752d43d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:31.950558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4b703-2035-4dcc-be91-266e752d43d8 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:31.976139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 709/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:33.111765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f6155-0bda-4eeb-bae8-851b003acdff None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:33.112329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f6155-0bda-4eeb-bae8-851b003acdff None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:33.112329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f6155-0bda-4eeb-bae8-851b003acdff None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:33.113640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:33.120881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc62b82-a09f-4c08-96c2-8228b91d2573 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:33.121616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc62b82-a09f-4c08-96c2-8228b91d2573 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:33.121823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc62b82-a09f-4c08-96c2-8228b91d2573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:33.151711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:33.211007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-adc62b82-a09f-4c08-96c2-8228b91d2573 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:33.212241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-adc62b82-a09f-4c08-96c2-8228b91d2573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:33.316982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:33.475257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f6155-0bda-4eeb-bae8-851b003acdff None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:33.477591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5e4f6155-0bda-4eeb-bae8-851b003acdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:33.603018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:33.640338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f6155-0bda-4eeb-bae8-851b003acdff None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:33.761812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b331b0-373e-4200-b33c-4faf9572c87c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:33.762348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b331b0-373e-4200-b33c-4faf9572c87c service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:33.762624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b331b0-373e-4200-b33c-4faf9572c87c service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:33.762943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b331b0-373e-4200-b33c-4faf9572c87c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:33.764553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e9b331b0-373e-4200-b33c-4faf9572c87c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:33.842842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:33.864588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b331b0-373e-4200-b33c-4faf9572c87c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:33.866179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b331b0-373e-4200-b33c-4faf9572c87c service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:33.884681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 715/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:35.015005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66b712-8cb3-4ab1-972f-99d59a8a3826 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:35.015831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66b712-8cb3-4ab1-972f-99d59a8a3826 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:35.015831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66b712-8cb3-4ab1-972f-99d59a8a3826 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:35.017931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:35.025060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043fdca-3ee4-436b-a489-620aa4da88ef None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:35.025550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043fdca-3ee4-436b-a489-620aa4da88ef None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:35.025656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043fdca-3ee4-436b-a489-620aa4da88ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:35.106155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0043fdca-3ee4-436b-a489-620aa4da88ef None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:35.107393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0043fdca-3ee4-436b-a489-620aa4da88ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:35.222530 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:35.374290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66b712-8cb3-4ab1-972f-99d59a8a3826 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:35.375860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-db66b712-8cb3-4ab1-972f-99d59a8a3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:35.463697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:35.528122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66b712-8cb3-4ab1-972f-99d59a8a3826 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:35.652101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7aaf1-a7e2-426d-b036-83f0ca799b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:35.652716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7aaf1-a7e2-426d-b036-83f0ca799b80 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:35.652987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7aaf1-a7e2-426d-b036-83f0ca799b80 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:35.653255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7aaf1-a7e2-426d-b036-83f0ca799b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:35.654925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-84e7aaf1-a7e2-426d-b036-83f0ca799b80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:35.716052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:35.762024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7aaf1-a7e2-426d-b036-83f0ca799b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:35.763660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7aaf1-a7e2-426d-b036-83f0ca799b80 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:35.781595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 712/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:36.851181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec55ab-6cd2-4574-bd90-9a3c8a189d65 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:36.851803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec55ab-6cd2-4574-bd90-9a3c8a189d65 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:36.851803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec55ab-6cd2-4574-bd90-9a3c8a189d65 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:36.853114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:36.860351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b3a9-db9c-451d-be0b-fda0fa81657e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:36.861093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b3a9-db9c-451d-be0b-fda0fa81657e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:36.861258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b3a9-db9c-451d-be0b-fda0fa81657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:36.941322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2316b3a9-db9c-451d-be0b-fda0fa81657e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:36.942463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2316b3a9-db9c-451d-be0b-fda0fa81657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:37.041669 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:37.190051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec55ab-6cd2-4574-bd90-9a3c8a189d65 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:37.191738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-61ec55ab-6cd2-4574-bd90-9a3c8a189d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:37.247257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:37.362092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec55ab-6cd2-4574-bd90-9a3c8a189d65 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:37.480352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f1880-1bcb-48bf-899c-5d38f83131ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:37.480879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1880-1bcb-48bf-899c-5d38f83131ff service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:37.481152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1880-1bcb-48bf-899c-5d38f83131ff service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:37.481420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1880-1bcb-48bf-899c-5d38f83131ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:37.483110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7c6f1880-1bcb-48bf-899c-5d38f83131ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:37.490808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:37.576488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f1880-1bcb-48bf-899c-5d38f83131ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:37.578053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f1880-1bcb-48bf-899c-5d38f83131ff service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:37.596305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 718/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:38.659300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1472f4d-4b59-47eb-860d-f9ef158e8582 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:38.659845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1472f4d-4b59-47eb-860d-f9ef158e8582 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:38.659845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1472f4d-4b59-47eb-860d-f9ef158e8582 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:38.661318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:38.669649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1278f-6f91-4a82-b4aa-9c477da04999 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:38.670220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1278f-6f91-4a82-b4aa-9c477da04999 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:38.670436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1278f-6f91-4a82-b4aa-9c477da04999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:38.751336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0da1278f-6f91-4a82-b4aa-9c477da04999 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:38.752498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0da1278f-6f91-4a82-b4aa-9c477da04999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:38.822298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:38.852458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:39.001467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1472f4d-4b59-47eb-860d-f9ef158e8582 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:39.002911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a1472f4d-4b59-47eb-860d-f9ef158e8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:39.022172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:39.162113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1472f4d-4b59-47eb-860d-f9ef158e8582 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:39.257004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:39.286451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794fec8-dd33-4bad-8bed-20f2d75ff39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:39.287106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794fec8-dd33-4bad-8bed-20f2d75ff39b service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:39.287384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794fec8-dd33-4bad-8bed-20f2d75ff39b service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:39.287641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794fec8-dd33-4bad-8bed-20f2d75ff39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:39.289264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4794fec8-dd33-4bad-8bed-20f2d75ff39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:39.383435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794fec8-dd33-4bad-8bed-20f2d75ff39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:39.385039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794fec8-dd33-4bad-8bed-20f2d75ff39b service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:39.403550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 715/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:40.446758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef85d1-9a54-46b8-a42d-dcb47fe28e6e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:40.447335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef85d1-9a54-46b8-a42d-dcb47fe28e6e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:40.447335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef85d1-9a54-46b8-a42d-dcb47fe28e6e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:40.448732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:40.455508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0a9b-ebb3-48bd-970b-acc95dd2010f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:40.455930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0a9b-ebb3-48bd-970b-acc95dd2010f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:40.456055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0a9b-ebb3-48bd-970b-acc95dd2010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:40.538151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fbdd0a9b-ebb3-48bd-970b-acc95dd2010f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:40.539387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fbdd0a9b-ebb3-48bd-970b-acc95dd2010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:40.590480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:40.648293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:40.800978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef85d1-9a54-46b8-a42d-dcb47fe28e6e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:40.803508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ceef85d1-9a54-46b8-a42d-dcb47fe28e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:40.969607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef85d1-9a54-46b8-a42d-dcb47fe28e6e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:41.029768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:41.092584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55eacf-f480-4b98-8a04-778b491ad8ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:41.093120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55eacf-f480-4b98-8a04-778b491ad8ed service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:41.093398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55eacf-f480-4b98-8a04-778b491ad8ed service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:41.093667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55eacf-f480-4b98-8a04-778b491ad8ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:41.095323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1e55eacf-f480-4b98-8a04-778b491ad8ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:41.320760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55eacf-f480-4b98-8a04-778b491ad8ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:41.323083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55eacf-f480-4b98-8a04-778b491ad8ed service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:41.345658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 721/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:42.380676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3206-89e8-437c-bf3c-a24d520abe53 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:42.381253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3206-89e8-437c-bf3c-a24d520abe53 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:42.381253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3206-89e8-437c-bf3c-a24d520abe53 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:42.383447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:23:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:42.390362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa9b36-8ed0-42f3-ba98-0adb6c646140 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:42.390902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa9b36-8ed0-42f3-ba98-0adb6c646140 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:42.390902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa9b36-8ed0-42f3-ba98-0adb6c646140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:42.469648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a2aa9b36-8ed0-42f3-ba98-0adb6c646140 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:42.470895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a2aa9b36-8ed0-42f3-ba98-0adb6c646140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:42.473112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:42.571326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:23:42.728819 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3206-89e8-437c-bf3c-a24d520abe53 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:42.731301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-135d3206-89e8-437c-bf3c-a24d520abe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:42.887270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3206-89e8-437c-bf3c-a24d520abe53 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:42.914830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:43.008739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04203ab5-5931-479a-b6fe-65db7829f840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:43.009268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04203ab5-5931-479a-b6fe-65db7829f840 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:43.009546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04203ab5-5931-479a-b6fe-65db7829f840 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:43.009814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04203ab5-5931-479a-b6fe-65db7829f840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:43.011450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-04203ab5-5931-479a-b6fe-65db7829f840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:43.103886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04203ab5-5931-479a-b6fe-65db7829f840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:43.105540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04203ab5-5931-479a-b6fe-65db7829f840 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:43.124447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 718/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:45.177738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442ae2b-a94e-45b0-bbd2-e111883c5561 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:45.178597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442ae2b-a94e-45b0-bbd2-e111883c5561 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:45.178597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442ae2b-a94e-45b0-bbd2-e111883c5561 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:45.180631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:23:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:45.186365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d76c-3ac8-4cff-b73d-40817d09cd55 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:45.186768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d76c-3ac8-4cff-b73d-40817d09cd55 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:45.186947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d76c-3ac8-4cff-b73d-40817d09cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:45.230859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:45.264978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3249d76c-3ac8-4cff-b73d-40817d09cd55 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:45.266200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3249d76c-3ac8-4cff-b73d-40817d09cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:45.388454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:45.680503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442ae2b-a94e-45b0-bbd2-e111883c5561 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:45.682061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a442ae2b-a94e-45b0-bbd2-e111883c5561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:45.794191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442ae2b-a94e-45b0-bbd2-e111883c5561 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:45.826806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:45.870227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed22339-b51e-4cf0-87d9-d16abc0ae2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:45.870969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed22339-b51e-4cf0-87d9-d16abc0ae2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:45.871247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed22339-b51e-4cf0-87d9-d16abc0ae2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:45.871513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed22339-b51e-4cf0-87d9-d16abc0ae2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:45.873274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3ed22339-b51e-4cf0-87d9-d16abc0ae2e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:45.993297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed22339-b51e-4cf0-87d9-d16abc0ae2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:45.994652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed22339-b51e-4cf0-87d9-d16abc0ae2e8 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:46.012551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 724/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:48.400792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857135f-5997-42c7-8531-64a74b7d98a4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:48.401667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857135f-5997-42c7-8531-64a74b7d98a4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:48.401667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857135f-5997-42c7-8531-64a74b7d98a4 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:48.403919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:23:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:48.410049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce5c8-f486-4bc4-9518-36c6f7e5bfd1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:48.411054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce5c8-f486-4bc4-9518-36c6f7e5bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:48.411054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce5c8-f486-4bc4-9518-36c6f7e5bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:48.479393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9ccce5c8-f486-4bc4-9518-36c6f7e5bfd1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:48.480614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9ccce5c8-f486-4bc4-9518-36c6f7e5bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:48.494368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:48.581110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:48.866596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857135f-5997-42c7-8531-64a74b7d98a4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:48.868225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6857135f-5997-42c7-8531-64a74b7d98a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:48.977204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857135f-5997-42c7-8531-64a74b7d98a4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:48.991418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:49.055635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54bece-e525-4bc0-89fd-cf9e979f3bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:49.056236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54bece-e525-4bc0-89fd-cf9e979f3bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:49.056509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54bece-e525-4bc0-89fd-cf9e979f3bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:49.056777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54bece-e525-4bc0-89fd-cf9e979f3bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:49.058358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0d54bece-e525-4bc0-89fd-cf9e979f3bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:49.171288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54bece-e525-4bc0-89fd-cf9e979f3bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:49.172735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54bece-e525-4bc0-89fd-cf9e979f3bcf service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:49.191674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 721/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:51.627410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab3b3-8b20-4b76-af02-263184aa1bde None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:51.627820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab3b3-8b20-4b76-af02-263184aa1bde None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:51.628150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab3b3-8b20-4b76-af02-263184aa1bde None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:51.630286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:51.638697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032be3aa-7c75-4f2c-a815-b5b9f7986543 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:51.639150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032be3aa-7c75-4f2c-a815-b5b9f7986543 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:51.639313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032be3aa-7c75-4f2c-a815-b5b9f7986543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:51.693524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:51.712575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-032be3aa-7c75-4f2c-a815-b5b9f7986543 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:51.713790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-032be3aa-7c75-4f2c-a815-b5b9f7986543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:51.815651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:52.105176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ab3b3-8b20-4b76-af02-263184aa1bde None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:52.107605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a30ab3b3-8b20-4b76-af02-263184aa1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:52.222606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ab3b3-8b20-4b76-af02-263184aa1bde None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:52.268679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:52.310990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423c740-33b3-40c6-bf13-1ae912a767f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:52.311816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c740-33b3-40c6-bf13-1ae912a767f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:52.312096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c740-33b3-40c6-bf13-1ae912a767f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:52.312440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c740-33b3-40c6-bf13-1ae912a767f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:52.314888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3423c740-33b3-40c6-bf13-1ae912a767f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:52.429067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423c740-33b3-40c6-bf13-1ae912a767f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:52.430503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423c740-33b3-40c6-bf13-1ae912a767f3 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:52.449114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 727/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:54.686845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261b8ed-58a7-46c2-b5f9-e9d6d27ef19d None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:54.687371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261b8ed-58a7-46c2-b5f9-e9d6d27ef19d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:54.687371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261b8ed-58a7-46c2-b5f9-e9d6d27ef19d None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:54.688766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:54.695274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc38c4-137f-4cd8-8b95-b996cbb4fc47 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:54.696017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc38c4-137f-4cd8-8b95-b996cbb4fc47 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:54.696178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc38c4-137f-4cd8-8b95-b996cbb4fc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:54.768892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-87dc38c4-137f-4cd8-8b95-b996cbb4fc47 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:54.770121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-87dc38c4-137f-4cd8-8b95-b996cbb4fc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:54.791764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:54.872181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:55.154436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261b8ed-58a7-46c2-b5f9-e9d6d27ef19d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:55.156044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a261b8ed-58a7-46c2-b5f9-e9d6d27ef19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:55.264490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261b8ed-58a7-46c2-b5f9-e9d6d27ef19d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:55.285460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:55.343975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81765-0a5d-4f3f-8534-31c45ce256b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:55.344585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81765-0a5d-4f3f-8534-31c45ce256b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:55.344862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81765-0a5d-4f3f-8534-31c45ce256b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:55.345132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81765-0a5d-4f3f-8534-31c45ce256b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:55.346745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b5a81765-0a5d-4f3f-8534-31c45ce256b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:55.457271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81765-0a5d-4f3f-8534-31c45ce256b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:55.458724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81765-0a5d-4f3f-8534-31c45ce256b9 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:55.477354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 724/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:23:57.688402 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546b646-1d37-428f-9b5d-d0fcdf8a193b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:57.688937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546b646-1d37-428f-9b5d-d0fcdf8a193b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:57.688937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546b646-1d37-428f-9b5d-d0fcdf8a193b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:57.690313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:23:57.695926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32f52-6420-4d9a-84b6-d88ee4a8c571 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:57.696367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32f52-6420-4d9a-84b6-d88ee4a8c571 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:57.696462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32f52-6420-4d9a-84b6-d88ee4a8c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:57.762990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:57.765602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-83e32f52-6420-4d9a-84b6-d88ee4a8c571 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:23:57.766813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-83e32f52-6420-4d9a-84b6-d88ee4a8c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:57.870912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:23:58.157533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546b646-1d37-428f-9b5d-d0fcdf8a193b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:23:58.160079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5546b646-1d37-428f-9b5d-d0fcdf8a193b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:58.282975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546b646-1d37-428f-9b5d-d0fcdf8a193b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:23:58.333223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:23:58.369433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec79e3-1d07-4731-a12e-97cec10dc4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:23:58.370127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec79e3-1d07-4731-a12e-97cec10dc4ba service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:23:58.370400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec79e3-1d07-4731-a12e-97cec10dc4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:23:58.370693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec79e3-1d07-4731-a12e-97cec10dc4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:23:58.372337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4bec79e3-1d07-4731-a12e-97cec10dc4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:23:58.497282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec79e3-1d07-4731-a12e-97cec10dc4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:23:58.498729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec79e3-1d07-4731-a12e-97cec10dc4ba service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:23:58.517677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 730/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:00.705170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422f84-f106-45c7-be6c-45cc1ac9e3df None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:00.705989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422f84-f106-45c7-be6c-45cc1ac9e3df None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:00.705989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422f84-f106-45c7-be6c-45cc1ac9e3df None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:00.708136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:24:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:00.716881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98839b-23eb-40ac-b55c-bcd3cc164e4b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:00.717521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98839b-23eb-40ac-b55c-bcd3cc164e4b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:00.717637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98839b-23eb-40ac-b55c-bcd3cc164e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:00.795107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-af98839b-23eb-40ac-b55c-bcd3cc164e4b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:00.796348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-af98839b-23eb-40ac-b55c-bcd3cc164e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:00.825984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:00.897385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:01.176390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85422f84-f106-45c7-be6c-45cc1ac9e3df None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:01.177993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-85422f84-f106-45c7-be6c-45cc1ac9e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:01.287348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85422f84-f106-45c7-be6c-45cc1ac9e3df None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:01.315117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:01.361085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bb429-da4d-4b60-aed2-cbfbc1c3943a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:01.361687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb429-da4d-4b60-aed2-cbfbc1c3943a service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:01.361957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb429-da4d-4b60-aed2-cbfbc1c3943a service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:01.362222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb429-da4d-4b60-aed2-cbfbc1c3943a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:01.363971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ab1bb429-da4d-4b60-aed2-cbfbc1c3943a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:01.475891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bb429-da4d-4b60-aed2-cbfbc1c3943a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:01.477264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bb429-da4d-4b60-aed2-cbfbc1c3943a service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:01.496772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 727/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:03.730649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecc34-be05-44c4-80a8-d763bfd11f3f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:03.731260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecc34-be05-44c4-80a8-d763bfd11f3f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:03.731260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecc34-be05-44c4-80a8-d763bfd11f3f None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:03.732580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:03.738147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1396d-e57b-48ea-a34f-a993b096c078 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:03.738608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1396d-e57b-48ea-a34f-a993b096c078 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:03.738717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1396d-e57b-48ea-a34f-a993b096c078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:03.806540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b8b1396d-e57b-48ea-a34f-a993b096c078 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:03.807781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b8b1396d-e57b-48ea-a34f-a993b096c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:03.816525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:03.914088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:04.202672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aecc34-be05-44c4-80a8-d763bfd11f3f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:04.205148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e8aecc34-be05-44c4-80a8-d763bfd11f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:04.312368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aecc34-be05-44c4-80a8-d763bfd11f3f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:04.369180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:04.387790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c4c6-d828-4fa7-8bbf-dcebf7fd00e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:04.388398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c4c6-d828-4fa7-8bbf-dcebf7fd00e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:04.388671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c4c6-d828-4fa7-8bbf-dcebf7fd00e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:04.388932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c4c6-d828-4fa7-8bbf-dcebf7fd00e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:04.390516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9ae5c4c6-d828-4fa7-8bbf-dcebf7fd00e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:04.504730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5c4c6-d828-4fa7-8bbf-dcebf7fd00e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:04.506085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5c4c6-d828-4fa7-8bbf-dcebf7fd00e3 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:04.524013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 733/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:06.713215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc5b17-f312-46a3-ba25-c6d094bbc20e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:06.713834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc5b17-f312-46a3-ba25-c6d094bbc20e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:06.713834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc5b17-f312-46a3-ba25-c6d094bbc20e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:06.715151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:06.721651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6f172-e8fa-45ef-a234-62f0e5a63bb9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:06.722370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6f172-e8fa-45ef-a234-62f0e5a63bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:06.722480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6f172-e8fa-45ef-a234-62f0e5a63bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:06.797386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4ee6f172-e8fa-45ef-a234-62f0e5a63bb9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:06.799297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4ee6f172-e8fa-45ef-a234-62f0e5a63bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:06.839840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:06.900444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:07.181084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc5b17-f312-46a3-ba25-c6d094bbc20e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:07.183747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-decc5b17-f312-46a3-ba25-c6d094bbc20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:07.298009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc5b17-f312-46a3-ba25-c6d094bbc20e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:07.337617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:07.385105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ceed6c-47f8-4565-bdc4-2cc36b8263b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:07.385718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceed6c-47f8-4565-bdc4-2cc36b8263b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:07.385993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceed6c-47f8-4565-bdc4-2cc36b8263b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:07.386265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceed6c-47f8-4565-bdc4-2cc36b8263b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:07.387911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-63ceed6c-47f8-4565-bdc4-2cc36b8263b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:07.503633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceed6c-47f8-4565-bdc4-2cc36b8263b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:07.505028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceed6c-47f8-4565-bdc4-2cc36b8263b8 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:07.523112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 730/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:09.682079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99d1c8-b182-4deb-9577-bb6222690108 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:09.683017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99d1c8-b182-4deb-9577-bb6222690108 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:09.683017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99d1c8-b182-4deb-9577-bb6222690108 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:09.685133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:24:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:09.690760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35732d5-b0b5-4e66-8e9b-fcc81235fcd1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:09.691254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35732d5-b0b5-4e66-8e9b-fcc81235fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:09.691368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35732d5-b0b5-4e66-8e9b-fcc81235fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:09.761015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f35732d5-b0b5-4e66-8e9b-fcc81235fcd1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:09.762230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f35732d5-b0b5-4e66-8e9b-fcc81235fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:09.782199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:09.876846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:10.160607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99d1c8-b182-4deb-9577-bb6222690108 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:10.162277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9a99d1c8-b182-4deb-9577-bb6222690108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:10.266731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99d1c8-b182-4deb-9577-bb6222690108 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:10.346237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:10.354232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ae74-9703-45d0-abb3-fe426105cd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:10.354855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ae74-9703-45d0-abb3-fe426105cd54 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:10.355152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ae74-9703-45d0-abb3-fe426105cd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:10.355415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ae74-9703-45d0-abb3-fe426105cd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:10.357030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-27c2ae74-9703-45d0-abb3-fe426105cd54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:10.472124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2ae74-9703-45d0-abb3-fe426105cd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:10.473497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2ae74-9703-45d0-abb3-fe426105cd54 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:10.491675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 736/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:12.680985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae9bf-0095-429b-80e7-b553e34214e0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:12.681539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae9bf-0095-429b-80e7-b553e34214e0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:12.681539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae9bf-0095-429b-80e7-b553e34214e0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:12.682861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:12.689248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeead532-43c6-4969-b241-ec582937a1b6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:12.689971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeead532-43c6-4969-b241-ec582937a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:12.690139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeead532-43c6-4969-b241-ec582937a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:12.776228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-eeead532-43c6-4969-b241-ec582937a1b6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:12.777441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-eeead532-43c6-4969-b241-ec582937a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:12.825760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:12.875708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:13.157780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae9bf-0095-429b-80e7-b553e34214e0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:13.160286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0f7ae9bf-0095-429b-80e7-b553e34214e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:13.279760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae9bf-0095-429b-80e7-b553e34214e0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:13.331901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:13.370067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b09f08-92de-4efe-acf7-27a8ea9529c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:13.370904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09f08-92de-4efe-acf7-27a8ea9529c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:13.371070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09f08-92de-4efe-acf7-27a8ea9529c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:13.371417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09f08-92de-4efe-acf7-27a8ea9529c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:13.373325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f4b09f08-92de-4efe-acf7-27a8ea9529c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:13.487837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b09f08-92de-4efe-acf7-27a8ea9529c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:13.489309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b09f08-92de-4efe-acf7-27a8ea9529c0 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:13.509067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 733/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:22.874102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=22 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:23.506130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=66 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:33.273477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa22c-9a48-4a93-8e69-e35effb5c4a8 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:33.274074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa22c-9a48-4a93-8e69-e35effb5c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:33.274074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa22c-9a48-4a93-8e69-e35effb5c4a8 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:33.275405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 738/1471] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:33.284512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39c5bb-3d0f-4640-afb1-f94d2a756d20 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:33.285248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39c5bb-3d0f-4640-afb1-f94d2a756d20 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:33.285448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39c5bb-3d0f-4640-afb1-f94d2a756d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:33.368841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fe39c5bb-3d0f-4640-afb1-f94d2a756d20 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:33.370789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fe39c5bb-3d0f-4640-afb1-f94d2a756d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:33.489683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 734/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:33.799304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6567-6c7e-4303-bab3-bed474501e46 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:33.799584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6567-6c7e-4303-bab3-bed474501e46 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:33.799853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6567-6c7e-4303-bab3-bed474501e46 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:33.801385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 739/1473] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 15 07:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:33.806396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b74bb-ee39-485a-9674-fc9e4cc0ec80 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:33.806681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b74bb-ee39-485a-9674-fc9e4cc0ec80 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:33.806997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b74bb-ee39-485a-9674-fc9e4cc0ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:33.884186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0e9b74bb-ee39-485a-9674-fc9e4cc0ec80 None None] MFA Rules not processed for user `e870f9d558024213a6db2c32a8d6de24`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:33.885394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0e9b74bb-ee39-485a-9674-fc9e4cc0ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:33.906641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:33.964947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 735/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 15 07:24:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:24:33.973270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6567-6c7e-4303-bab3-bed474501e46 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:33.974849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-36da6567-6c7e-4303-bab3-bed474501e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:34.090405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6567-6c7e-4303-bab3-bed474501e46 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:34.171961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b28a2d-c7a2-4215-9bf2-45c0e659a63a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:34.172565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b28a2d-c7a2-4215-9bf2-45c0e659a63a service glance] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:34.172796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b28a2d-c7a2-4215-9bf2-45c0e659a63a service glance] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:34.173080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b28a2d-c7a2-4215-9bf2-45c0e659a63a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:34.174663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6b28a2d-c7a2-4215-9bf2-45c0e659a63a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:34.230771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:34.288554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b28a2d-c7a2-4215-9bf2-45c0e659a63a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:34.289999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b28a2d-c7a2-4215-9bf2-45c0e659a63a service glance] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:34.308755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 740/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:36.547214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da288e3-657b-4fae-8cb3-b061cea0e9f9 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:36.547825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da288e3-657b-4fae-8cb3-b061cea0e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:36.547825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da288e3-657b-4fae-8cb3-b061cea0e9f9 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:36.549139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 736/1476] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 07:24:36.555805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064fc4-7d37-4231-8dbd-e7dd5ba0e723 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:36.556248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064fc4-7d37-4231-8dbd-e7dd5ba0e723 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:36.556360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064fc4-7d37-4231-8dbd-e7dd5ba0e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:36.629031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a7064fc4-7d37-4231-8dbd-e7dd5ba0e723 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:36.630298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a7064fc4-7d37-4231-8dbd-e7dd5ba0e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:36.742368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 741/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:37.001059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da288e3-657b-4fae-8cb3-b061cea0e9f9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:37.003536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3da288e3-657b-4fae-8cb3-b061cea0e9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:37.153792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da288e3-657b-4fae-8cb3-b061cea0e9f9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:37.210982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:37.257620 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a376-6022-48be-a6be-b0b8af905651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:37.258175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a376-6022-48be-a6be-b0b8af905651 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:37.258450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a376-6022-48be-a6be-b0b8af905651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:37.258712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a376-6022-48be-a6be-b0b8af905651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:37.259391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a376-6022-48be-a6be-b0b8af905651 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:37.261183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-f1b2a376-6022-48be-a6be-b0b8af905651 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:24:37.261183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:24:37.261183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:24:37.262332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a376-6022-48be-a6be-b0b8af905651 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:37.281406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 737/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 15 07:24:36 2022] GET /identity/v3/projects => generated 2553 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:24:39.432602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201e6b-7749-4e7c-9c65-469c76c117fb None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:39.433217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201e6b-7749-4e7c-9c65-469c76c117fb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:39.433217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201e6b-7749-4e7c-9c65-469c76c117fb None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:39.434491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 742/1479] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:39.440441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc5fd-7c93-4a97-8a59-6875d175cc73 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:39.440916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc5fd-7c93-4a97-8a59-6875d175cc73 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:39.441297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc5fd-7c93-4a97-8a59-6875d175cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:39.511200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f13fc5fd-7c93-4a97-8a59-6875d175cc73 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:39.512426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f13fc5fd-7c93-4a97-8a59-6875d175cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:39.618019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 738/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:39.917443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9201e6b-7749-4e7c-9c65-469c76c117fb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:39.919586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f9201e6b-7749-4e7c-9c65-469c76c117fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:39.931875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:40.072653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9201e6b-7749-4e7c-9c65-469c76c117fb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:40.158565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:40.194147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921411b-906a-4381-a0e1-0537c1f31c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:40.194747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921411b-906a-4381-a0e1-0537c1f31c08 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:40.195048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921411b-906a-4381-a0e1-0537c1f31c08 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:40.195315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921411b-906a-4381-a0e1-0537c1f31c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:40.196916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2921411b-906a-4381-a0e1-0537c1f31c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:40.297123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921411b-906a-4381-a0e1-0537c1f31c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:40.298735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921411b-906a-4381-a0e1-0537c1f31c08 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:40.317063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 743/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:42.636958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7830-d1ed-4ee2-bffa-fc5c37d26107 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:42.637722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7830-d1ed-4ee2-bffa-fc5c37d26107 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:42.637832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e7830-d1ed-4ee2-bffa-fc5c37d26107 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:42.640126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 739/1482] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:24:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:42.645996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bce012-5dcd-47fe-ab10-f93496e4602d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:42.646430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bce012-5dcd-47fe-ab10-f93496e4602d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:42.646542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bce012-5dcd-47fe-ab10-f93496e4602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:42.717046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d0bce012-5dcd-47fe-ab10-f93496e4602d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:42.718306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d0bce012-5dcd-47fe-ab10-f93496e4602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:42.767559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:42.819461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 744/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:24:43.106637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7830-d1ed-4ee2-bffa-fc5c37d26107 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:43.109324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-305e7830-d1ed-4ee2-bffa-fc5c37d26107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:43.141932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:43.234194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e7830-d1ed-4ee2-bffa-fc5c37d26107 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:43.308999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51c247-6e02-4cc6-b5be-a0909ff0c812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:43.309609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51c247-6e02-4cc6-b5be-a0909ff0c812 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:43.309882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51c247-6e02-4cc6-b5be-a0909ff0c812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:43.310149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51c247-6e02-4cc6-b5be-a0909ff0c812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:43.311796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-db51c247-6e02-4cc6-b5be-a0909ff0c812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:43.394691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:43.430411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51c247-6e02-4cc6-b5be-a0909ff0c812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:43.431900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51c247-6e02-4cc6-b5be-a0909ff0c812 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:43.450094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 740/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:45.641735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a14880-4220-4840-b432-f32ac75fd240 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:45.642251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a14880-4220-4840-b432-f32ac75fd240 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:45.642366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a14880-4220-4840-b432-f32ac75fd240 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:45.644434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 745/1485] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:45.650184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9fe9c-5a43-4512-aeb0-c45d57ec7765 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:45.650646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9fe9c-5a43-4512-aeb0-c45d57ec7765 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:45.650748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9fe9c-5a43-4512-aeb0-c45d57ec7765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:45.722481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b2c9fe9c-5a43-4512-aeb0-c45d57ec7765 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:45.725210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b2c9fe9c-5a43-4512-aeb0-c45d57ec7765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:45.834797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 741/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:46.120540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a14880-4220-4840-b432-f32ac75fd240 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:46.122901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-82a14880-4220-4840-b432-f32ac75fd240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:46.240011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a14880-4220-4840-b432-f32ac75fd240 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:46.317460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:46.319118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de6ac6-75d1-49ee-a1e4-f4c08fa1cc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:46.319720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de6ac6-75d1-49ee-a1e4-f4c08fa1cc2c service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:46.320001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de6ac6-75d1-49ee-a1e4-f4c08fa1cc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:46.320241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de6ac6-75d1-49ee-a1e4-f4c08fa1cc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:46.322434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f3de6ac6-75d1-49ee-a1e4-f4c08fa1cc2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:46.437102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de6ac6-75d1-49ee-a1e4-f4c08fa1cc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:46.438555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de6ac6-75d1-49ee-a1e4-f4c08fa1cc2c service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:46.456751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 746/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:48.763759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0075e53-7657-440b-8097-f80d5d0bee01 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:48.764621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0075e53-7657-440b-8097-f80d5d0bee01 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:48.764621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0075e53-7657-440b-8097-f80d5d0bee01 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:48.766599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 742/1488] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:24:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:48.773541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025694c-aa68-4257-a63b-90f8cfe4ac53 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:48.773984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025694c-aa68-4257-a63b-90f8cfe4ac53 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:48.774080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025694c-aa68-4257-a63b-90f8cfe4ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:48.850787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9025694c-aa68-4257-a63b-90f8cfe4ac53 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:48.852066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9025694c-aa68-4257-a63b-90f8cfe4ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:48.918101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:48.973002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 747/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:49.273504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0075e53-7657-440b-8097-f80d5d0bee01 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:49.276084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c0075e53-7657-440b-8097-f80d5d0bee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:49.317103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:49.389043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0075e53-7657-440b-8097-f80d5d0bee01 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:49.592711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f97b5a-1098-45f1-a68b-f3d5137dfecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:49.593233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f97b5a-1098-45f1-a68b-f3d5137dfecc service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:49.593515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f97b5a-1098-45f1-a68b-f3d5137dfecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:49.593773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f97b5a-1098-45f1-a68b-f3d5137dfecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:49.595383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-71f97b5a-1098-45f1-a68b-f3d5137dfecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:49.680577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:49.710788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f97b5a-1098-45f1-a68b-f3d5137dfecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:49.712325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f97b5a-1098-45f1-a68b-f3d5137dfecc service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:49.730811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 743/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:24:52.056208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88211d9-a5ab-4350-ac32-c9129ec9fe73 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:52.057047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88211d9-a5ab-4350-ac32-c9129ec9fe73 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:52.057047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88211d9-a5ab-4350-ac32-c9129ec9fe73 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:52.059190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 748/1491] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 15 07:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:24:52.068051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285041e6-6746-4f9b-b7e5-08f45b53060e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:52.068450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285041e6-6746-4f9b-b7e5-08f45b53060e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:52.068595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285041e6-6746-4f9b-b7e5-08f45b53060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:52.138320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-285041e6-6746-4f9b-b7e5-08f45b53060e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:24:52.139587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-285041e6-6746-4f9b-b7e5-08f45b53060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:52.237837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 744/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 15 07:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:24:52.530227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88211d9-a5ab-4350-ac32-c9129ec9fe73 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:24:52.531861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f88211d9-a5ab-4350-ac32-c9129ec9fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:52.642423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88211d9-a5ab-4350-ac32-c9129ec9fe73 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:24:52.719878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa317-9cb0-4d16-a138-c129a68054c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:24:52.720463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa317-9cb0-4d16-a138-c129a68054c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:24:52.720764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa317-9cb0-4d16-a138-c129a68054c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:24:52.721031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa317-9cb0-4d16-a138-c129a68054c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:24:52.722630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bcffa317-9cb0-4d16-a138-c129a68054c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:24:52.731681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:24:52.839626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffa317-9cb0-4d16-a138-c129a68054c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:24:52.841336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffa317-9cb0-4d16-a138-c129a68054c1 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:24:52.867048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 749/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:25:02.236318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=82 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:25:02.862946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=50 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:26:39.479566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c02c-ee3b-44ac-a548-1353d9b60a30 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:39.480219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c02c-ee3b-44ac-a548-1353d9b60a30 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:39.480219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c02c-ee3b-44ac-a548-1353d9b60a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:39.565499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-46c9c02c-ee3b-44ac-a548-1353d9b60a30 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:26:39.566695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-46c9c02c-ee3b-44ac-a548-1353d9b60a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:26:39.682912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 745/1494] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:26:39.691277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d30ef-8011-4bca-b1ae-863c90414b55 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:39.691779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d30ef-8011-4bca-b1ae-863c90414b55 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:39.691779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d30ef-8011-4bca-b1ae-863c90414b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:39.712786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c49d30ef-8011-4bca-b1ae-863c90414b55 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:26:39.713995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c49d30ef-8011-4bca-b1ae-863c90414b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:26:39.724100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 750/1495] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:26:39.731501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c02c-ee3b-44ac-a548-1353d9b60a30 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:39.742036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c02c-ee3b-44ac-a548-1353d9b60a30 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:39.751075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:39.751692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:39.751967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:39.752237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:39.752890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:26:39.753223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:39.754262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:39.754262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:26:39.754262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:26:39.755188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:39.767335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 746/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:26:39.775994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d30ef-8011-4bca-b1ae-863c90414b55 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:39.785725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d30ef-8011-4bca-b1ae-863c90414b55 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:39.790867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:39.791487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:39.791758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:39.792022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:39.792654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:39.794389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:39.794389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 15 07:26:39.794389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: Sep 15 07:26:39.795621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:39.839754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 751/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:26:39 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:26:39.844668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:39.854756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04cfd-bd0f-434f-a4a7-6ebde3060f1c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:39.911027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:26:39.919221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:39.919830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:39.920102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:39.920369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:39.921000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:39.922080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:39.922080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:26:39.922080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:26:39.923315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:39.946309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 747/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:26:39 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:26:39.950789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:39.961707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df597-cfe1-4f6f-aadc-d7b3129d6eb6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:39.966774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:39.967406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:39.967691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:39.967953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:39.968604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:39.969623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:39.969623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 15 07:26:39.969623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: Sep 15 07:26:39.970506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:39.984256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 752/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:26:39.988350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:39.998233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b579340-4b37-4b42-b21f-257f846cb03e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:40.003255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc62773-46b7-4774-b8f4-735bfdcd86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:40.003834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62773-46b7-4774-b8f4-735bfdcd86be admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.004101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62773-46b7-4774-b8f4-735bfdcd86be admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.004359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62773-46b7-4774-b8f4-735bfdcd86be admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.004997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc62773-46b7-4774-b8f4-735bfdcd86be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:40.005993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-fdc62773-46b7-4774-b8f4-735bfdcd86be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:40.005993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:26:40.005993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:26:40.006961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc62773-46b7-4774-b8f4-735bfdcd86be admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:40.020395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 748/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:26:40.024693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:40.035836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bfdc-2a42-4670-8ca9-31d4ff655346 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:40.041566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a4b21-e668-414a-8bc4-41e751f01c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:40.042234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4b21-e668-414a-8bc4-41e751f01c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.042519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4b21-e668-414a-8bc4-41e751f01c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.042772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a4b21-e668-414a-8bc4-41e751f01c57 admin admin] PATH_INFO: `/v3/projects/27a8522d02f4418481deb7693225f839/users/64096fec6a014953977fa21eaac8b4b6/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.059593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a4b21-e668-414a-8bc4-41e751f01c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a8522d02f4418481deb7693225f839, user_id=64096fec6a014953977fa21eaac8b4b6, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:40.060619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-2d6a4b21-e668-414a-8bc4-41e751f01c57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:40.060619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 15 07:26:40.060619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: Sep 15 07:26:40.062713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a4b21-e668-414a-8bc4-41e751f01c57 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:40.081672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 753/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:26:40 2022] PUT /identity/v3/projects/27a8522d02f4418481deb7693225f839/users/64096fec6a014953977fa21eaac8b4b6/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:26:40.096379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3eb4-17a6-4592-9d93-df471e6f9988 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.096663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3eb4-17a6-4592-9d93-df471e6f9988 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.096929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3eb4-17a6-4592-9d93-df471e6f9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.133801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c3bf3eb4-17a6-4592-9d93-df471e6f9988 None None] MFA Rules not processed for user `64096fec6a014953977fa21eaac8b4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:26:40.135049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c3bf3eb4-17a6-4592-9d93-df471e6f9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:26:40.202442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 749/1502] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:26:40.216335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb35f8-8c26-4516-baa1-3686bd496fe3 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.216612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb35f8-8c26-4516-baa1-3686bd496fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.216879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb35f8-8c26-4516-baa1-3686bd496fe3 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.218219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 754/1503] 10.222.0.15 () {54 vars in 964 bytes} [Thu Sep 15 07:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:26:40.223076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfddcc-5e8c-4256-9ef0-2a66dd1aab56 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.223356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfddcc-5e8c-4256-9ef0-2a66dd1aab56 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.223655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfddcc-5e8c-4256-9ef0-2a66dd1aab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.285554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-89bfddcc-5e8c-4256-9ef0-2a66dd1aab56 None None] MFA Rules not processed for user `2cc638eccee04ac6a71972e255947aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:26:40.286685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-89bfddcc-5e8c-4256-9ef0-2a66dd1aab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:26:40.370138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 750/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Sep 15 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:26:40.379847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb35f8-8c26-4516-baa1-3686bd496fe3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:40.392229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb35f8-8c26-4516-baa1-3686bd496fe3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:40.396529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:40.397103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.397347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.397642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.406147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:40.407641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:40.416539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 755/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:26:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:26:40.462164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22702675-7991-4441-b0a3-ab459f063abe None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.462442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22702675-7991-4441-b0a3-ab459f063abe None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.462717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22702675-7991-4441-b0a3-ab459f063abe None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.464025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 751/1506] 10.222.0.15 () {52 vars in 830 bytes} [Thu Sep 15 07:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:26:40.468092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:40.531006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56003d98-66dd-4220-9703-bc5993fe1260 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:40.536066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:40.536623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.536895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.537150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] PATH_INFO: `/v3/users/64096fec6a014953977fa21eaac8b4b6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.538287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64096fec6a014953977fa21eaac8b4b6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:40.539334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:40.539334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 15 07:26:40.539334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: Sep 15 07:26:40.540536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:40.612528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64096fec6a014953977fa21eaac8b4b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:40.623883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64096fec6a014953977fa21eaac8b4b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:40.651550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64096fec6a014953977fa21eaac8b4b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:40.652264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64096fec6a014953977fa21eaac8b4b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:40.653016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64096fec6a014953977fa21eaac8b4b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:40.663156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:26:40.674815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 756/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:26:40 2022] DELETE /identity/v3/users/64096fec6a014953977fa21eaac8b4b6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:26:40.679600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.680082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.680188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.699362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:26:40.700534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:26:40.709943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:26:40.762860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 752/1508] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:26:40.773819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:40.775454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:26:40.861354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c81258-a085-4683-afeb-1932d10325e5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:40.865287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2d764-4c5e-4256-b0ff-110190f01ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:40.865903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2d764-4c5e-4256-b0ff-110190f01ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:40.866171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2d764-4c5e-4256-b0ff-110190f01ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:40.866432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2d764-4c5e-4256-b0ff-110190f01ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:40.876008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2d764-4c5e-4256-b0ff-110190f01ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:40.877448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2d764-4c5e-4256-b0ff-110190f01ed9 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:40.886741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 757/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:26:41.258034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:26:41.259885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:26:41.272192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97971563-d987-4ec4-b953-60cab1dbd49b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:26:41.278622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:26:41.279657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:26:41.279657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:26:41.279851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] PATH_INFO: `/v3/projects/27a8522d02f4418481deb7693225f839` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:26:41.281909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a8522d02f4418481deb7693225f839)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:26:41.283319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:26:41.283319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:26:41.283319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:26:41.284532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:26:41.349540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a8522d02f4418481deb7693225f839', 'request_id': 'req-e966e1bd-0ae8-42c1-9afc-e441d5372964'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:41.356051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a8522d02f4418481deb7693225f839', 'request_id': 'req-e966e1bd-0ae8-42c1-9afc-e441d5372964'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:41.366228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a8522d02f4418481deb7693225f839', 'request_id': 'req-e966e1bd-0ae8-42c1-9afc-e441d5372964'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:41.384752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] The token cache is being invalidate because project 27a8522d02f4418481deb7693225f839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:26:41.385000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:41.385612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e966e1bd-0ae8-42c1-9afc-e441d5372964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:26:41.387331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 753/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:26:41 2022] DELETE /identity/v3/projects/27a8522d02f4418481deb7693225f839 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:26:50.882710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=38 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:26:51.381564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:28:16.476040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b8e8-7fe9-4d1c-8e1c-828558ade1dc None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:16.477031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b8e8-7fe9-4d1c-8e1c-828558ade1dc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:16.477031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b8e8-7fe9-4d1c-8e1c-828558ade1dc None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:16.479034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:28:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:16.484501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573c0b4-a2aa-4190-8a38-233983ebd514 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:16.484981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573c0b4-a2aa-4190-8a38-233983ebd514 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:16.484981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573c0b4-a2aa-4190-8a38-233983ebd514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:16.505681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c573c0b4-a2aa-4190-8a38-233983ebd514 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:16.506807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c573c0b4-a2aa-4190-8a38-233983ebd514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:16.569978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:16.721003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b8e8-7fe9-4d1c-8e1c-828558ade1dc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:16.723837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2178b8e8-7fe9-4d1c-8e1c-828558ade1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:16.831791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b8e8-7fe9-4d1c-8e1c-828558ade1dc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:16.838667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6b8aa-38bb-433b-ba63-49502f3ab4c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:16.839384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6b8aa-38bb-433b-ba63-49502f3ab4c4 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:16.839660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6b8aa-38bb-433b-ba63-49502f3ab4c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:16.840373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6b8aa-38bb-433b-ba63-49502f3ab4c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:16.849309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6b8aa-38bb-433b-ba63-49502f3ab4c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:16.850952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6b8aa-38bb-433b-ba63-49502f3ab4c4 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:16.860555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 759/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:17.934302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba66eb-5466-434f-a868-f8755c04e1df None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:17.935286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba66eb-5466-434f-a868-f8755c04e1df None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:17.935286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba66eb-5466-434f-a868-f8755c04e1df None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:17.937783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:28:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:17.944171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b8cd-ebbe-4c70-829d-0277b794b816 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:17.944622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b8cd-ebbe-4c70-829d-0277b794b816 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:17.944717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b8cd-ebbe-4c70-829d-0277b794b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:17.965246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5390b8cd-ebbe-4c70-829d-0277b794b816 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:17.966458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5390b8cd-ebbe-4c70-829d-0277b794b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:17.974927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:18.128129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba66eb-5466-434f-a868-f8755c04e1df None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:18.146954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba66eb-5466-434f-a868-f8755c04e1df None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:18.153084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51452b27-3b9f-473c-877a-5a3a39d69cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:18.153680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452b27-3b9f-473c-877a-5a3a39d69cc4 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:18.153949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452b27-3b9f-473c-877a-5a3a39d69cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:18.154211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452b27-3b9f-473c-877a-5a3a39d69cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:18.162985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51452b27-3b9f-473c-877a-5a3a39d69cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:18.164602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51452b27-3b9f-473c-877a-5a3a39d69cc4 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:18.175087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 756/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:18.805901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55b08e-5119-4fe8-822b-47cb739a722f None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:18.806137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55b08e-5119-4fe8-822b-47cb739a722f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:18.806366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55b08e-5119-4fe8-822b-47cb739a722f None None] PATH_INFO: `/v3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:18.808299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 761/1517] 10.222.0.16 () {54 vars in 925 bytes} [Thu Sep 15 07:28:18 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:28:18.829852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51748792-ed98-4c6e-ac20-1d61b6a9f47c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:18.830136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51748792-ed98-4c6e-ac20-1d61b6a9f47c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:18.830404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51748792-ed98-4c6e-ac20-1d61b6a9f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:18.888653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-51748792-ed98-4c6e-ac20-1d61b6a9f47c None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:18.889859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-51748792-ed98-4c6e-ac20-1d61b6a9f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:18.968986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 757/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 15 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:22.598112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb7ff-a354-4230-8dbd-7d00a6691ccc None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:22.598658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb7ff-a354-4230-8dbd-7d00a6691ccc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:22.598658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb7ff-a354-4230-8dbd-7d00a6691ccc None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:22.600122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 762/1519] 10.222.0.15 () {54 vars in 961 bytes} [Thu Sep 15 07:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:22.605396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c546211-6070-4ab1-89c7-e81e0f853f89 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:22.605845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c546211-6070-4ab1-89c7-e81e0f853f89 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:22.605962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c546211-6070-4ab1-89c7-e81e0f853f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:22.627328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3c546211-6070-4ab1-89c7-e81e0f853f89 None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:22.628543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3c546211-6070-4ab1-89c7-e81e0f853f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:22.637905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 758/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Sep 15 07:28:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:22.645712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eb7ff-a354-4230-8dbd-7d00a6691ccc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:22.660253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eb7ff-a354-4230-8dbd-7d00a6691ccc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:22.665766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b7fe1-e378-4f1e-bfcb-49db0e204792 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:22.666359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7fe1-e378-4f1e-bfcb-49db0e204792 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:22.666633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7fe1-e378-4f1e-bfcb-49db0e204792 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:22.666927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7fe1-e378-4f1e-bfcb-49db0e204792 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:22.675321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b7fe1-e378-4f1e-bfcb-49db0e204792 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:22.676893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b7fe1-e378-4f1e-bfcb-49db0e204792 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:22.687009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 763/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:29.648090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2c39-3024-40d4-9a6c-f249246f58b3 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:29.648570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2c39-3024-40d4-9a6c-f249246f58b3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:29.648669 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2c39-3024-40d4-9a6c-f249246f58b3 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:29.649987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:29.656669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9ec3a-3265-4c7c-97e5-e691330d6182 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:29.657111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9ec3a-3265-4c7c-97e5-e691330d6182 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:29.657576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9ec3a-3265-4c7c-97e5-e691330d6182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:29.679577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e5f9ec3a-3265-4c7c-97e5-e691330d6182 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:29.680782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e5f9ec3a-3265-4c7c-97e5-e691330d6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:29.689643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:29.847968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee2c39-3024-40d4-9a6c-f249246f58b3 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:29.863231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee2c39-3024-40d4-9a6c-f249246f58b3 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:29.868815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fb62f-0b9e-4238-b167-8f83c8ff9d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:29.869412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb62f-0b9e-4238-b167-8f83c8ff9d91 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:29.869691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb62f-0b9e-4238-b167-8f83c8ff9d91 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:29.869962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb62f-0b9e-4238-b167-8f83c8ff9d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:29.878133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fb62f-0b9e-4238-b167-8f83c8ff9d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:29.879705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fb62f-0b9e-4238-b167-8f83c8ff9d91 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:29.889266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 760/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:30.956624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3aa45-49a4-4f52-a235-8986aa8a2f84 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:30.957152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3aa45-49a4-4f52-a235-8986aa8a2f84 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:30.957152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3aa45-49a4-4f52-a235-8986aa8a2f84 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:30.959187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 07:28:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:30.969340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bab67-60c9-4d2a-b25a-638807b4401f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:30.969818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bab67-60c9-4d2a-b25a-638807b4401f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:30.969916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bab67-60c9-4d2a-b25a-638807b4401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:31.000350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c49bab67-60c9-4d2a-b25a-638807b4401f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:31.001564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c49bab67-60c9-4d2a-b25a-638807b4401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:31.011061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 07:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:31.160058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3aa45-49a4-4f52-a235-8986aa8a2f84 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:31.184806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3aa45-49a4-4f52-a235-8986aa8a2f84 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:31.194323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3392f9-4005-4bc5-b1d3-9d1f3ae79711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:31.194977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3392f9-4005-4bc5-b1d3-9d1f3ae79711 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:31.195248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3392f9-4005-4bc5-b1d3-9d1f3ae79711 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:31.195509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3392f9-4005-4bc5-b1d3-9d1f3ae79711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:31.204484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3392f9-4005-4bc5-b1d3-9d1f3ae79711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:31.206072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3392f9-4005-4bc5-b1d3-9d1f3ae79711 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:31.215689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 766/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:28:35.195208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855952-3470-4ae2-9ff3-59751b7076f5 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:35.196107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855952-3470-4ae2-9ff3-59751b7076f5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:35.196107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855952-3470-4ae2-9ff3-59751b7076f5 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:35.198329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:28:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:35.204903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc47a6-4be0-43f4-bb30-9793a77b2b61 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:35.205327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc47a6-4be0-43f4-bb30-9793a77b2b61 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:35.205437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc47a6-4be0-43f4-bb30-9793a77b2b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:35.226721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b5dc47a6-4be0-43f4-bb30-9793a77b2b61 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:35.227979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b5dc47a6-4be0-43f4-bb30-9793a77b2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:35.237526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:35.531433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855952-3470-4ae2-9ff3-59751b7076f5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:35.533363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4b855952-3470-4ae2-9ff3-59751b7076f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:35.564593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:28:35.602607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855952-3470-4ae2-9ff3-59751b7076f5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:35.606520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2049ea-7af0-4602-986f-52a40ef2c680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:35.607183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2049ea-7af0-4602-986f-52a40ef2c680 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:35.607464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2049ea-7af0-4602-986f-52a40ef2c680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:35.607729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2049ea-7af0-4602-986f-52a40ef2c680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:35.617635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2049ea-7af0-4602-986f-52a40ef2c680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:35.619127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2049ea-7af0-4602-986f-52a40ef2c680 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:35.629615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 763/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:37.756543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879fdf8-097f-4171-a5b6-0ab73de655bf None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:37.757474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879fdf8-097f-4171-a5b6-0ab73de655bf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:37.757474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879fdf8-097f-4171-a5b6-0ab73de655bf None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:37.759683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:28:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:37.766229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c108f4-2423-4b7a-abc7-f4cd9c9e3ec2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:37.766927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c108f4-2423-4b7a-abc7-f4cd9c9e3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:37.767084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c108f4-2423-4b7a-abc7-f4cd9c9e3ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:37.791849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-67c108f4-2423-4b7a-abc7-f4cd9c9e3ec2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:37.793042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-67c108f4-2423-4b7a-abc7-f4cd9c9e3ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:37.802031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:38.088939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879fdf8-097f-4171-a5b6-0ab73de655bf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:38.091492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3879fdf8-097f-4171-a5b6-0ab73de655bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:38.106022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879fdf8-097f-4171-a5b6-0ab73de655bf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:38.109785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4ced5-047b-4551-8c95-90662458ec5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:38.110381 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ced5-047b-4551-8c95-90662458ec5d service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:38.110656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ced5-047b-4551-8c95-90662458ec5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:38.110952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ced5-047b-4551-8c95-90662458ec5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:38.119886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4ced5-047b-4551-8c95-90662458ec5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:38.121306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4ced5-047b-4551-8c95-90662458ec5d service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:38.130733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 769/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:41.649208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761baa48-471c-4a90-82cf-60be42faa48f None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:41.649709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761baa48-471c-4a90-82cf-60be42faa48f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:41.649807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761baa48-471c-4a90-82cf-60be42faa48f None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:41.651211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:41.656798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3e3c-9bea-4e4c-9a2e-092771bc01e2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:41.657248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3e3c-9bea-4e4c-9a2e-092771bc01e2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:41.657345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3e3c-9bea-4e4c-9a2e-092771bc01e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:41.665510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=74 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:28:41.678189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-08bd3e3c-9bea-4e4c-9a2e-092771bc01e2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:41.679433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-08bd3e3c-9bea-4e4c-9a2e-092771bc01e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:41.687844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:41.990572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761baa48-471c-4a90-82cf-60be42faa48f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:41.992776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-761baa48-471c-4a90-82cf-60be42faa48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:42.060261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761baa48-471c-4a90-82cf-60be42faa48f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:42.067189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d84cb-4bda-4869-9892-65554e88fcc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:42.067944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d84cb-4bda-4869-9892-65554e88fcc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:42.068212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d84cb-4bda-4869-9892-65554e88fcc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:42.068472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d84cb-4bda-4869-9892-65554e88fcc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:42.081265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d84cb-4bda-4869-9892-65554e88fcc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:42.082702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d84cb-4bda-4869-9892-65554e88fcc7 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:42.092625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 766/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:44.246960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d2f3-a4c9-415f-9d6a-3eb6af764d58 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:44.247659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d2f3-a4c9-415f-9d6a-3eb6af764d58 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:44.247659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d2f3-a4c9-415f-9d6a-3eb6af764d58 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:44.249535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 07:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:28:44.255066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb450-6821-40af-a113-e6940f1accc6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:44.255531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb450-6821-40af-a113-e6940f1accc6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:44.255633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb450-6821-40af-a113-e6940f1accc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:44.276356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-519cb450-6821-40af-a113-e6940f1accc6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:28:44.277561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-519cb450-6821-40af-a113-e6940f1accc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:44.286035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 07:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:28:44.586148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d2f3-a4c9-415f-9d6a-3eb6af764d58 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:28:44.588145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8ee6d2f3-a4c9-415f-9d6a-3eb6af764d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:28:44.603648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d2f3-a4c9-415f-9d6a-3eb6af764d58 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:28:44.607941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bdf7d-9ecb-4353-b4c4-a1b17998b3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:28:44.608540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bdf7d-9ecb-4353-b4c4-a1b17998b3be service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:28:44.608813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bdf7d-9ecb-4353-b4c4-a1b17998b3be service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:28:44.609087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bdf7d-9ecb-4353-b4c4-a1b17998b3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:28:44.619180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bdf7d-9ecb-4353-b4c4-a1b17998b3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:28:44.620616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bdf7d-9ecb-4353-b4c4-a1b17998b3be service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:28:44.631566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 772/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:28:54.270883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=47 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:28:54.626771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=8 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:14.086186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad89dd-a0ab-4fac-9f96-6fb3fb03eb2b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.086930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad89dd-a0ab-4fac-9f96-6fb3fb03eb2b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.086930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad89dd-a0ab-4fac-9f96-6fb3fb03eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.113041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f5ad89dd-a0ab-4fac-9f96-6fb3fb03eb2b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.114295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f5ad89dd-a0ab-4fac-9f96-6fb3fb03eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.125905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 768/1540] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:30:14.135725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cb62f-d29a-42e4-9e55-87593c59d83b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.136365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cb62f-d29a-42e4-9e55-87593c59d83b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.136365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cb62f-d29a-42e4-9e55-87593c59d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.171465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5d6cb62f-d29a-42e4-9e55-87593c59d83b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.172878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5d6cb62f-d29a-42e4-9e55-87593c59d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.177422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d929-c6f3-4baa-b688-407ae1f0baa0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.177911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d929-c6f3-4baa-b688-407ae1f0baa0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.178350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d929-c6f3-4baa-b688-407ae1f0baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.193291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 773/1541] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.194562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490145-94e1-4fc7-9803-e90c82397585 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.197306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490145-94e1-4fc7-9803-e90c82397585 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.197622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490145-94e1-4fc7-9803-e90c82397585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.211810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6c75d929-c6f3-4baa-b688-407ae1f0baa0 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.213487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6c75d929-c6f3-4baa-b688-407ae1f0baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.227951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 769/1542] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.229595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e03eb-d5a2-48e8-8b42-2df6fb5f1b25 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.230064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e03eb-d5a2-48e8-8b42-2df6fb5f1b25 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.230497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e03eb-d5a2-48e8-8b42-2df6fb5f1b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.231550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b9490145-94e1-4fc7-9803-e90c82397585 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.232971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b9490145-94e1-4fc7-9803-e90c82397585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.253431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 774/1543] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.254595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490145-94e1-4fc7-9803-e90c82397585 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.262899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d14e03eb-d5a2-48e8-8b42-2df6fb5f1b25 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.264355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d14e03eb-d5a2-48e8-8b42-2df6fb5f1b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.267407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490145-94e1-4fc7-9803-e90c82397585 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.279724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.280617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.281052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.281487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.282409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.282593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 770/1544] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.284082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08e5a-3d68-46de-8209-95756ea7c0a9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.284554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.285863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:30:14.285863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 15 07:30:14.285863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: Sep 15 07:30:14.286495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08e5a-3d68-46de-8209-95756ea7c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.287609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b1709-bfe3-471d-879b-d901ce6d22f7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.288117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08e5a-3d68-46de-8209-95756ea7c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.310623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 775/1545] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:14.316639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a112-1889-40bf-b2fb-6b9583e30b60 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.317102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a112-1889-40bf-b2fb-6b9583e30b60 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.317557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a112-1889-40bf-b2fb-6b9583e30b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.322913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8ed08e5a-3d68-46de-8209-95756ea7c0a9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.323486 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8ed08e5a-3d68-46de-8209-95756ea7c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.334227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 771/1546] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.341080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ea5f-4b0e-463f-9f92-c252fd4d0484 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.341592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ea5f-4b0e-463f-9f92-c252fd4d0484 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.342098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ea5f-4b0e-463f-9f92-c252fd4d0484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.348737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d816a112-1889-40bf-b2fb-6b9583e30b60 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.349983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d816a112-1889-40bf-b2fb-6b9583e30b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.361875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 776/1547] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.363113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59f7d-b0a1-4c0f-b2f0-1761701f1d5f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.363394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59f7d-b0a1-4c0f-b2f0-1761701f1d5f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.363667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59f7d-b0a1-4c0f-b2f0-1761701f1d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.372168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7929ea5f-4b0e-463f-9f92-c252fd4d0484 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.373396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7929ea5f-4b0e-463f-9f92-c252fd4d0484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.381945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 772/1548] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.383200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e31a6-f967-410f-bd74-ee55d5edf4f7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.383493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e31a6-f967-410f-bd74-ee55d5edf4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.383766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e31a6-f967-410f-bd74-ee55d5edf4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.394359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6ef59f7d-b0a1-4c0f-b2f0-1761701f1d5f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.395582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6ef59f7d-b0a1-4c0f-b2f0-1761701f1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.403190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b15e31a6-f967-410f-bd74-ee55d5edf4f7 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.403694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 777/1549] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.404355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b15e31a6-f967-410f-bd74-ee55d5edf4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.404595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef59f7d-b0a1-4c0f-b2f0-1761701f1d5f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.412171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 773/1550] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.413039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e31a6-f967-410f-bd74-ee55d5edf4f7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.413959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef59f7d-b0a1-4c0f-b2f0-1761701f1d5f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.422320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482cbc-0920-4f2b-9b9c-4d6faf06b28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.422951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482cbc-0920-4f2b-9b9c-4d6faf06b28e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.423231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482cbc-0920-4f2b-9b9c-4d6faf06b28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.423473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482cbc-0920-4f2b-9b9c-4d6faf06b28e admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.424075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3482cbc-0920-4f2b-9b9c-4d6faf06b28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.425965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3482cbc-0920-4f2b-9b9c-4d6faf06b28e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.428010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e31a6-f967-410f-bd74-ee55d5edf4f7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.432811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed40ab-82f6-40cf-a8cd-6d2bccb9495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.433403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed40ab-82f6-40cf-a8cd-6d2bccb9495b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.433680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed40ab-82f6-40cf-a8cd-6d2bccb9495b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.433980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed40ab-82f6-40cf-a8cd-6d2bccb9495b admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.434648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed40ab-82f6-40cf-a8cd-6d2bccb9495b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.434984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed40ab-82f6-40cf-a8cd-6d2bccb9495b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.436629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed40ab-82f6-40cf-a8cd-6d2bccb9495b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.448781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 774/1551] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:14.449994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eb80-88fc-4c2d-940e-58fd2d006713 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.450276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eb80-88fc-4c2d-940e-58fd2d006713 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.450548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eb80-88fc-4c2d-940e-58fd2d006713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.457433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 778/1552] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:14.458924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f93bd-8579-40cb-bb45-02cd1f2ecb2a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.459212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f93bd-8579-40cb-bb45-02cd1f2ecb2a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.459477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f93bd-8579-40cb-bb45-02cd1f2ecb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.473516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a643eb80-88fc-4c2d-940e-58fd2d006713 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.474737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a643eb80-88fc-4c2d-940e-58fd2d006713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.479575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-324f93bd-8579-40cb-bb45-02cd1f2ecb2a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.480787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-324f93bd-8579-40cb-bb45-02cd1f2ecb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.533732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 775/1553] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.535043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b792d-d132-431d-81a8-e4b024346b04 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.535199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b792d-d132-431d-81a8-e4b024346b04 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.535454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b792d-d132-431d-81a8-e4b024346b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.544447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 779/1554] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.545217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f93bd-8579-40cb-bb45-02cd1f2ecb2a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.555581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f93bd-8579-40cb-bb45-02cd1f2ecb2a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.556816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ce5b792d-d132-431d-81a8-e4b024346b04 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.558087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ce5b792d-d132-431d-81a8-e4b024346b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.560235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81799a7-f15f-4842-9b1c-a59c422f1e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.560848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81799a7-f15f-4842-9b1c-a59c422f1e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.561154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81799a7-f15f-4842-9b1c-a59c422f1e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.561426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81799a7-f15f-4842-9b1c-a59c422f1e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.562080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81799a7-f15f-4842-9b1c-a59c422f1e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.562388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81799a7-f15f-4842-9b1c-a59c422f1e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.564022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81799a7-f15f-4842-9b1c-a59c422f1e46 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.566998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 776/1555] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.567821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b792d-d132-431d-81a8-e4b024346b04 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.583005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 780/1556] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:14.583005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4cb2-89fd-4910-ba85-c2c755b5cd5b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.583280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b792d-d132-431d-81a8-e4b024346b04 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.583373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4cb2-89fd-4910-ba85-c2c755b5cd5b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.583373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4cb2-89fd-4910-ba85-c2c755b5cd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.583528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.583528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.583706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.584040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.584685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.584982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.586716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.598847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-de1f4cb2-89fd-4910-ba85-c2c755b5cd5b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.599145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 777/1557] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:14.599938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.600128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-de1f4cb2-89fd-4910-ba85-c2c755b5cd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.609898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085f315-5c7c-4d28-9de4-5e21a4be0dc9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.613316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 781/1558] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.614095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4cb2-89fd-4910-ba85-c2c755b5cd5b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.616685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53eb1-54be-4a02-b26d-acdbd44b3571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.616685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53eb1-54be-4a02-b26d-acdbd44b3571 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.616913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53eb1-54be-4a02-b26d-acdbd44b3571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.617283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53eb1-54be-4a02-b26d-acdbd44b3571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.617989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53eb1-54be-4a02-b26d-acdbd44b3571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.619128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-7fa53eb1-54be-4a02-b26d-acdbd44b3571 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:30:14.619128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:30:14.619128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:30:14.620436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53eb1-54be-4a02-b26d-acdbd44b3571 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.627270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4cb2-89fd-4910-ba85-c2c755b5cd5b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.631374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.631980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.632256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.632521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.633274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.634288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:30:14.634288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 15 07:30:14.634288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: Sep 15 07:30:14.635557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.649129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 778/1559] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:14.650394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc7b51-d7f6-4396-8359-0a205884812a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.650679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc7b51-d7f6-4396-8359-0a205884812a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.651039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc7b51-d7f6-4396-8359-0a205884812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.664218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 782/1560] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:14.664218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.671624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575cf6e-2d7f-45a3-87db-a462a5f5b282 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.672330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-cafc7b51-d7f6-4396-8359-0a205884812a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.673549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cafc7b51-d7f6-4396-8359-0a205884812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.730094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.730763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.731009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.731273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.731916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.732211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.733382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 779/1561] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.733931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.734619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f556d0e-baa0-4c0e-8284-93e6979fa2c8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.734952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f556d0e-baa0-4c0e-8284-93e6979fa2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.735204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f556d0e-baa0-4c0e-8284-93e6979fa2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.737709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:14.748757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 783/1562] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:14.749547 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.756799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:14.758159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3f556d0e-baa0-4c0e-8284-93e6979fa2c8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:14.759066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88e670-755c-4a98-b946-44b4e0534de7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.759467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3f556d0e-baa0-4c0e-8284-93e6979fa2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:14.764210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.764801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.765092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.765358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.765985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.767899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.769647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 780/1563] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:14.770464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f556d0e-baa0-4c0e-8284-93e6979fa2c8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.780439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f556d0e-baa0-4c0e-8284-93e6979fa2c8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.785993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.786663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.787027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.787383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.788051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.790102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.797124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 784/1564] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:14.797894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.823137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 781/1565] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:14.823940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.862317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eefecf-da37-4513-b440-6e0457cfd62f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.885169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04a55-3b4b-43bc-804d-92af03af4553 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.889898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.890505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.890794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.891112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.891739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.893677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.916981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 782/1566] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:14.917851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.922006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.922685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.923046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.923319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.923970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.924272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.925877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.927858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7485d1-7e0c-4a83-b27c-428579941488 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.933141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.933744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.934122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.934396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.935103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.936703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.938474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 785/1567] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:14.939323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.947702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 783/1568] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:14.948702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.950635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93104845-54dc-4331-bedf-2e0cd1be9920 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.955745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.956323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.956633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.956873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.957548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.957852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.959158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83fb70-27e8-4ac2-942e-5c8a1460a758 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.959442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.963902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.964837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.965107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.965369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.965991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.967914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:14.972066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 786/1569] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:14.972954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:14.983046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd0476-d21f-44a3-80f8-2b267d7702d4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:14.988384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:14.989073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:14.989356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:14.989649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:14.990370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:14.990900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:14.992538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.000557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 784/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.000557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.006395 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 787/1571] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:15.011110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.020573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ebe6-305f-4bc2-8380-cfc4113175cf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.063067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955819ab-fe0f-404a-9d41-3752932e8d03 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.064816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:15.068110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.068777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.069124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.069453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.070099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.072228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.078180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.078805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.079111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.079379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.080015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.081988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.094305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 785/1572] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:14 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.095914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.103945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 788/1573] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.105042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.106086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9dc6b-38b3-4463-bb23-21e9ac9cd429 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.111443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.112146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.112547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.112787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.113412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.114341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99d44-5409-42ac-b9f8-e027808d6925 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.115065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.118927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.119520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.119836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.120112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.120741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.122802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.125526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 786/1574] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.126410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.136328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93223a2-b64c-47c1-99e7-b5a6ea6301f8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.141063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.141734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.142089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.142360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.143089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.144874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.155285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 789/1575] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.160408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 787/1576] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.160408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.160608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.162680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:15.168966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5bad7-8469-448a-858a-37a2474a0de8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.220123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15c4f-372b-4800-9797-dfa335eceae6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.224855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.225489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.225802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.226073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.227411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.227564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.227658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.227658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.227810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.228361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.228879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.231024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.253149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 788/1577] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.253958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.262093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 790/1578] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.262093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.266264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc05f59-0b35-4968-af09-c1a19d30188f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.319585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2b6f-3617-4c03-820d-af3c8b460e64 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.321477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.322108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.322497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.322776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.323468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.324372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.324987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.325266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.325436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.325539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.326165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.327792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.339159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 791/1579] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.343272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.356671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674ac0c-01ab-4de3-84b1-6056b9b0f088 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.361399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.362078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.362666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.362804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 789/1580] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.362946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.363336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.363658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.365224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.378402 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 792/1581] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.379970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.393877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf772-7da0-473b-bd6a-2f46779a62ff admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.417738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:15.428224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd307c-bec9-4b51-ad70-ec100416f63c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.433953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.434576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.434898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.435164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.435819 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.437448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.451438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 790/1582] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.451438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.452289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.452975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.453314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.453781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.454486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.456544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.459062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef00af-0686-46bb-bada-e308edc3ce6f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.463611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.464580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.464869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.465147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] PATH_INFO: `/v3/projects/c1c57261914d45dfa480bfa3dda25cf2/users/c0cb3d32205b485eb96d1de3f5e0749f/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.479177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 793/1583] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.480082 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.482764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:15.484492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c57261914d45dfa480bfa3dda25cf2, user_id=c0cb3d32205b485eb96d1de3f5e0749f, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.485680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:30:15.485680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:30:15.485680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:30:15.488151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.490047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d39a-334c-436d-b6a8-bdb228f98673 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.495732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.496474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.496775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.497072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.497725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.499363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.502632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 791/1584] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:15 2022] PUT /identity/v3/projects/c1c57261914d45dfa480bfa3dda25cf2/users/c0cb3d32205b485eb96d1de3f5e0749f/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:15.503373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.514089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 794/1585] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.514089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.523831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aed28-bee2-4cb1-a3db-68a9b4a0803c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.567617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29be7-8512-4e6d-9613-885a0af1650e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.572584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.573240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.573511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.573781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.574408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.576408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.579427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.580039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.580319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.580591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.581231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.582837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.593423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 795/1586] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.594295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.599496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 792/1587] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.600490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.604319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6879f-6c6a-4c1d-a0db-dea0dbc2f837 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.609053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.609650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.609922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.610187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.610620 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1eef8a-7a1c-4652-bdca-0596da7ebac1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.610797 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.612833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.619720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.620387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.620859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.624782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.624782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.624782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.635401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 793/1588] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.636194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.643286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 796/1589] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:15.643286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.648713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17c76e-4f99-4735-b2a1-5423086f0e7f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.651306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8f5a5-40d7-45df-a63c-7d4f0c620351 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.653857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.654617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.655053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.655330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] PATH_INFO: `/v3/projects/598fa5694fc64cc58de07b1a29d19eb6/users/afcc52b05d414578a880e78944a7d7a7/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.658045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ade279-787e-41e6-af90-5813d1a2ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.659758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade279-787e-41e6-af90-5813d1a2ad0c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.660113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade279-787e-41e6-af90-5813d1a2ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.660451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade279-787e-41e6-af90-5813d1a2ad0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.661168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ade279-787e-41e6-af90-5813d1a2ad0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.662851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ade279-787e-41e6-af90-5813d1a2ad0c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.675705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598fa5694fc64cc58de07b1a29d19eb6, user_id=afcc52b05d414578a880e78944a7d7a7, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.677256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 797/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.678625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.680516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75044-7092-4e67-85ea-8511af2c577f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.680804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75044-7092-4e67-85ea-8511af2c577f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.681078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75044-7092-4e67-85ea-8511af2c577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.694549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 794/1591] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:15 2022] PUT /identity/v3/projects/598fa5694fc64cc58de07b1a29d19eb6/users/afcc52b05d414578a880e78944a7d7a7/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:15.695235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.707788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cbd75044-7092-4e67-85ea-8511af2c577f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:15.709049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cbd75044-7092-4e67-85ea-8511af2c577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:15.763751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779a8b4-1147-4fd5-9108-1e405cf219b9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.770374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.771027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.771307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.771580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.772230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.773928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.774290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 798/1592] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:15.775669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd75044-7092-4e67-85ea-8511af2c577f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.786989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 795/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.787198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd75044-7092-4e67-85ea-8511af2c577f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.787289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.792166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.792886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.793173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.793447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] PATH_INFO: `/v3/projects/0da7d88a12e6416b88afbe2753942190/users/92087877ad074bee9655c1a55fb5ba71/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.797916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4be3d7-c085-45d7-ae07-37f2d1a2053a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.802603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.803268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.803545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.803814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.804460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.805757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:15.806091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.809913 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da7d88a12e6416b88afbe2753942190, user_id=92087877ad074bee9655c1a55fb5ba71, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.812909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.816543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 796/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.818255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.828509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6c3a-bd6e-42d8-9bec-1039401860b3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.829208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 799/1595] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:15 2022] PUT /identity/v3/projects/0da7d88a12e6416b88afbe2753942190/users/92087877ad074bee9655c1a55fb5ba71/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:15.831661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.860328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:15.894662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd81551-aab0-4189-bb5e-347e7b683cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.895369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81551-aab0-4189-bb5e-347e7b683cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.895651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81551-aab0-4189-bb5e-347e7b683cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.895913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81551-aab0-4189-bb5e-347e7b683cac admin admin] PATH_INFO: `/v3/projects/533d9fdb402949a4b3146567e19e17fe/users/445e5c56aac147988c83825075678d44/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.901440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2300c5-b5e0-4962-a23e-ea94151b290e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.906040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.906650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.906964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.907235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.907881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.909481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.911462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81551-aab0-4189-bb5e-347e7b683cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=533d9fdb402949a4b3146567e19e17fe, user_id=445e5c56aac147988c83825075678d44, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:15.914459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81551-aab0-4189-bb5e-347e7b683cac admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:15.922667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 800/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:15.922667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:15.930654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 797/1597] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:15 2022] PUT /identity/v3/projects/533d9fdb402949a4b3146567e19e17fe/users/445e5c56aac147988c83825075678d44/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:15.931174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab53b0-1f2e-486d-8d2e-07f458f10282 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:15.936092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35758c7f-a047-4bcb-b9b8-a8d80023f22e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:15.936381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35758c7f-a047-4bcb-b9b8-a8d80023f22e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:15.936648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35758c7f-a047-4bcb-b9b8-a8d80023f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:15.967364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-35758c7f-a047-4bcb-b9b8-a8d80023f22e None None] MFA Rules not processed for user `afcc52b05d414578a880e78944a7d7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:15.969183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-35758c7f-a047-4bcb-b9b8-a8d80023f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:15.998984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:15.999716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.000072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.000369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.001007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.002651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.013899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 801/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:16.014802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.038953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 798/1599] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:16.039778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35758c7f-a047-4bcb-b9b8-a8d80023f22e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.052097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35758c7f-a047-4bcb-b9b8-a8d80023f22e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.057295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.058252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.058665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.059032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] PATH_INFO: `/v3/projects/cc9d7aabb5144ebbb94d21373e1ab166/users/e7bde5a9cc43477696f27d84a21467ed/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.075695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9d7aabb5144ebbb94d21373e1ab166, user_id=e7bde5a9cc43477696f27d84a21467ed, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.078540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.099529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 799/1600] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:16 2022] PUT /identity/v3/projects/cc9d7aabb5144ebbb94d21373e1ab166/users/e7bde5a9cc43477696f27d84a21467ed/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:16.100241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.114426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a2ab8-6b6e-4103-bcf4-4b1986bbcdcd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.151506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:16.165021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb95f1-3142-4876-84f1-124f766c1359 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.169063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.169750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.170033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.170293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.170409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcde03-978b-4294-b96c-94982a72a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.171084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcde03-978b-4294-b96c-94982a72a7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.171428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcde03-978b-4294-b96c-94982a72a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.171771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcde03-978b-4294-b96c-94982a72a7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.172639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcde03-978b-4294-b96c-94982a72a7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.174400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcde03-978b-4294-b96c-94982a72a7e4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.179905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.181318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.185791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 800/1601] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:16.187163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6def-2ed9-4231-ab35-1067044d1ef0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.187470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6def-2ed9-4231-ab35-1067044d1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.187819 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6def-2ed9-4231-ab35-1067044d1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.192827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 802/1602] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:16.194935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.209944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-af6b6def-2ed9-4231-ab35-1067044d1ef0 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:16.211916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-af6b6def-2ed9-4231-ab35-1067044d1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:16.218864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105f920-aabe-4d02-b4ee-ce1822062ef9 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.222582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 801/1603] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:16.225947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.227039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.227441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dc22d-3fe4-473e-ba60-5f9027415625 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.227625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.227743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dc22d-3fe4-473e-ba60-5f9027415625 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.228035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dc22d-3fe4-473e-ba60-5f9027415625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.228316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.229158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.231646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.242444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:16.248299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 803/1604] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:16.249185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.250927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-fd8dc22d-3fe4-473e-ba60-5f9027415625 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:16.252833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fd8dc22d-3fe4-473e-ba60-5f9027415625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:16.260414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e2586-9325-447a-93b2-58643bd468b2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.265351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.266026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.266306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.267189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] PATH_INFO: `/v3/projects/a171567589504cd19122a993881d5250/users/0e421a45c825416fa5bf4aec29ed0c6b/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.267305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 802/1605] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:16.268707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb52bc-ae6c-419f-9891-d13da170f4dd None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.269495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb52bc-ae6c-419f-9891-d13da170f4dd None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.269495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb52bc-ae6c-419f-9891-d13da170f4dd None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.278992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 803/1606] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 15 07:30:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:16.280235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607e249-9f9b-47fb-a7e5-083f60b56922 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.280571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607e249-9f9b-47fb-a7e5-083f60b56922 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.280845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607e249-9f9b-47fb-a7e5-083f60b56922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.288949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a171567589504cd19122a993881d5250, user_id=0e421a45c825416fa5bf4aec29ed0c6b, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.292079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.316979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 804/1607] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:16 2022] PUT /identity/v3/projects/a171567589504cd19122a993881d5250/users/0e421a45c825416fa5bf4aec29ed0c6b/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:16.318501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.325248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9607e249-9f9b-47fb-a7e5-083f60b56922 None None] MFA Rules not processed for user `e7bde5a9cc43477696f27d84a21467ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:16.326547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9607e249-9f9b-47fb-a7e5-083f60b56922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:16.412883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13a879-6b1d-483b-8880-b84c022a7ab7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.417027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 804/1608] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:16.421177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607e249-9f9b-47fb-a7e5-083f60b56922 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.421933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.422633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.423008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.423286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] PATH_INFO: `/v3/projects/406a6caacd5340c29a22dc598ac6143e/users/d0c237c7eef746ee9cf9b4269a41afad/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.440908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=406a6caacd5340c29a22dc598ac6143e, user_id=d0c237c7eef746ee9cf9b4269a41afad, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.444097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.476363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 805/1609] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:16 2022] PUT /identity/v3/projects/406a6caacd5340c29a22dc598ac6143e/users/d0c237c7eef746ee9cf9b4269a41afad/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:16.476363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.500523 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607e249-9f9b-47fb-a7e5-083f60b56922 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.566339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.566663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506c66d-9556-4cb5-ba23-5797a6fa41bd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.567611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.568170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.568710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.571598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699362c-0e50-4177-8a7d-cc3eefefb5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.572410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699362c-0e50-4177-8a7d-cc3eefefb5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.572697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699362c-0e50-4177-8a7d-cc3eefefb5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.573121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699362c-0e50-4177-8a7d-cc3eefefb5e0 admin admin] PATH_INFO: `/v3/projects/7345dbd2abc44a009ecd2093e79bdb01/users/ea21235f22f14e6f8e9649c65f8a683f/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.583898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.585691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.596593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699362c-0e50-4177-8a7d-cc3eefefb5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7345dbd2abc44a009ecd2093e79bdb01, user_id=ea21235f22f14e6f8e9649c65f8a683f, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.598304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 805/1610] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:16.599237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.600665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699362c-0e50-4177-8a7d-cc3eefefb5e0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.608474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ab79-f77d-4db4-8950-d0747d8d6df8 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.612504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9c04a-4ac9-4add-bf21-2a78dddb84ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.613107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9c04a-4ac9-4add-bf21-2a78dddb84ce service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.613519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9c04a-4ac9-4add-bf21-2a78dddb84ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.613782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9c04a-4ac9-4add-bf21-2a78dddb84ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.626572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9c04a-4ac9-4add-bf21-2a78dddb84ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:16.628325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9c04a-4ac9-4add-bf21-2a78dddb84ce service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:16.635507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 806/1611] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:16 2022] PUT /identity/v3/projects/7345dbd2abc44a009ecd2093e79bdb01/users/ea21235f22f14e6f8e9649c65f8a683f/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:16.640882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbccd-7d4b-426e-aab6-98c5b3ff991d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.643367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbccd-7d4b-426e-aab6-98c5b3ff991d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.643685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbccd-7d4b-426e-aab6-98c5b3ff991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.645645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 806/1612] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:16.647379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383259-892c-4f16-bb30-f28c457e9413 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.647901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383259-892c-4f16-bb30-f28c457e9413 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.648391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383259-892c-4f16-bb30-f28c457e9413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.670679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b2383259-892c-4f16-bb30-f28c457e9413 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:16.672075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b2383259-892c-4f16-bb30-f28c457e9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:16.696601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:16.716738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:16.770695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b3cfbccd-7d4b-426e-aab6-98c5b3ff991d None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:16.772809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b3cfbccd-7d4b-426e-aab6-98c5b3ff991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:16.790424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 807/1613] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:16.804522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383259-892c-4f16-bb30-f28c457e9413 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:16.947517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 807/1614] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 15 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:16.950249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba6f7-49f8-4799-9e74-a205b3576c3d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.950765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba6f7-49f8-4799-9e74-a205b3576c3d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.951281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba6f7-49f8-4799-9e74-a205b3576c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:16.969345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383259-892c-4f16-bb30-f28c457e9413 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:16.981900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:16.983141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:16.984632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:16.985570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.058956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-742ba6f7-49f8-4799-9e74-a205b3576c3d None None] MFA Rules not processed for user `d0c237c7eef746ee9cf9b4269a41afad`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:17.065985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-742ba6f7-49f8-4799-9e74-a205b3576c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:17.271093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:17.273371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 808/1615] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:17.273863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:17.275676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08382f-175e-42d4-b3dc-3e3bf0cfca6a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:17.277371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08382f-175e-42d4-b3dc-3e3bf0cfca6a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:17.282080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08382f-175e-42d4-b3dc-3e3bf0cfca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.316049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 808/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:17.319019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:17.389291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fd08382f-175e-42d4-b3dc-3e3bf0cfca6a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:17.399798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fd08382f-175e-42d4-b3dc-3e3bf0cfca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:17.429940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 809/1617] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:17.431421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08382f-175e-42d4-b3dc-3e3bf0cfca6a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:17.488338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08382f-175e-42d4-b3dc-3e3bf0cfca6a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:17.512394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:17.515777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:17.516982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:17.518128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.649953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fb70-ad60-42c8-afed-ab1a52c150a3 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:17.661137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274fef-ca9b-4927-b8b3-f4eccca4d1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:17.661951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fef-ca9b-4927-b8b3-f4eccca4d1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:17.662237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fef-ca9b-4927-b8b3-f4eccca4d1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:17.663133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fef-ca9b-4927-b8b3-f4eccca4d1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.689800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274fef-ca9b-4927-b8b3-f4eccca4d1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:17.692907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274fef-ca9b-4927-b8b3-f4eccca4d1a5 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:17.699802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:17.703766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:17.724618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 809/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:17.728699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed438a48-f585-4e4f-9c3a-3da835cbb56a None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:17.728809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed438a48-f585-4e4f-9c3a-3da835cbb56a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:17.728995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed438a48-f585-4e4f-9c3a-3da835cbb56a None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.731132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 810/1619] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:17.731968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:17.741982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 810/1620] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 15 07:30:17 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:17.744304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba707a-21c1-4e91-b9a4-a03dbd2f9333 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:17.744587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba707a-21c1-4e91-b9a4-a03dbd2f9333 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:17.746506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba707a-21c1-4e91-b9a4-a03dbd2f9333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.757230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4cc4-8407-4efc-966f-f1c473c5e554 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:17.769491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da33d-c102-4edd-85cb-78a6be309dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:17.770277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da33d-c102-4edd-85cb-78a6be309dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:17.770563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da33d-c102-4edd-85cb-78a6be309dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:17.770861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da33d-c102-4edd-85cb-78a6be309dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.789882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-64ba707a-21c1-4e91-b9a4-a03dbd2f9333 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:17.792540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da33d-c102-4edd-85cb-78a6be309dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:17.794188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da33d-c102-4edd-85cb-78a6be309dbb service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:17.795533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-64ba707a-21c1-4e91-b9a4-a03dbd2f9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:17.804744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:17.824073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 811/1621] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 15 07:30:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:17.826203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 811/1622] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:17.827139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba707a-21c1-4e91-b9a4-a03dbd2f9333 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:17.849472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba707a-21c1-4e91-b9a4-a03dbd2f9333 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:17.864795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347ee67-4155-4580-bb16-cb4bc2070758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:17.865679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347ee67-4155-4580-bb16-cb4bc2070758 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:17.866032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347ee67-4155-4580-bb16-cb4bc2070758 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:17.867358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347ee67-4155-4580-bb16-cb4bc2070758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:17.888539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347ee67-4155-4580-bb16-cb4bc2070758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:17.893429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347ee67-4155-4580-bb16-cb4bc2070758 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:17.931832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 812/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:18.054961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20b51-a13e-4ff5-acd5-64b742e4ed80 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.055294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20b51-a13e-4ff5-acd5-64b742e4ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.055679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20b51-a13e-4ff5-acd5-64b742e4ed80 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.057667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 812/1624] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 15 07:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:18.065564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ff9bb-ff14-4ffd-acdf-08d8aac89886 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.067575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ff9bb-ff14-4ffd-acdf-08d8aac89886 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.068025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ff9bb-ff14-4ffd-acdf-08d8aac89886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.106649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948000b-e71e-4a50-a974-27129a89a251 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.107199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948000b-e71e-4a50-a974-27129a89a251 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.107600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948000b-e71e-4a50-a974-27129a89a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.113397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-565ff9bb-ff14-4ffd-acdf-08d8aac89886 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:18.118219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-565ff9bb-ff14-4ffd-acdf-08d8aac89886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:18.145394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 813/1625] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:30:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:18.163031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ff9bb-ff14-4ffd-acdf-08d8aac89886 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:18.182694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1948000b-e71e-4a50-a974-27129a89a251 None None] MFA Rules not processed for user `445e5c56aac147988c83825075678d44`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:18.184130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1948000b-e71e-4a50-a974-27129a89a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:18.193153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ff9bb-ff14-4ffd-acdf-08d8aac89886 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:18.204850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:18.206774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.208339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.211635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.227635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:18.247817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:18.249268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:18.294390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 814/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:18.356185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 813/1627] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:30:18.360978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:18.394769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f344108-badd-424b-b111-16ea4baf3c36 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:18.409475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:18.411704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.412229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.422199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.423064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:18.425127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:18.515070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 815/1628] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:18 2022] POST /identity/v3/projects => generated 403 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:18.515264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c40ab-637d-4bd3-b84e-b233b1bc0685 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.515264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c40ab-637d-4bd3-b84e-b233b1bc0685 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.515264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c40ab-637d-4bd3-b84e-b233b1bc0685 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.515567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:18.516241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 814/1629] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 15 07:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:18.522681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bed21-3b30-48cf-a76f-916a884c49b7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.523023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bed21-3b30-48cf-a76f-916a884c49b7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.523347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bed21-3b30-48cf-a76f-916a884c49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.549139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-763bed21-3b30-48cf-a76f-916a884c49b7 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:18.550738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-763bed21-3b30-48cf-a76f-916a884c49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:18.662992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caea6f0-97a5-41d7-9e29-d5cb9655e9de admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:18.683593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:18.684245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.684548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.684793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.685443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:18.687442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:18.717347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 815/1630] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:30:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:30:18.726678 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bed21-3b30-48cf-a76f-916a884c49b7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:18.762228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 816/1631] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:18 2022] POST /identity/v3/users => generated 308 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:18.763537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:18.794671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a7698-c4b6-413c-919c-1f25b458ccbc admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:18.809690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bed21-3b30-48cf-a76f-916a884c49b7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:18.814203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:18.815124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.815602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.816066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.816913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:18.818280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:18.818950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.819229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.819848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.830630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:18.844394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:18.846903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:18.866180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 817/1632] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:18.867445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:18.868199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 816/1633] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:30:18.903369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03a70-4668-4fe7-a18e-80526a1b88e9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:18.928860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:18.929963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:18.930404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:18.930865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] PATH_INFO: `/v3/projects/11ee6ac9b4c84e7c9354901397aaea45/users/bd0f0a4d7b7d471cb10f99f1efd1a942/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:18.987161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ee6ac9b4c84e7c9354901397aaea45, user_id=bd0f0a4d7b7d471cb10f99f1efd1a942, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:18.990114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:19.027300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 818/1634] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:18 2022] PUT /identity/v3/projects/11ee6ac9b4c84e7c9354901397aaea45/users/bd0f0a4d7b7d471cb10f99f1efd1a942/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:19.029105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:19.044769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7e76-1194-4d59-82a3-3d78f9d1987a service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:19.107021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:19.206226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:19.209273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:19.209849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:19.210658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:19.212506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:19.216427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:19.245014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 817/1635] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:19.249300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:19.266225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1dc9f-adf7-44e2-ae17-34728174d68a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:19.307239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2c0a5-2719-4642-b628-8f592c177568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:19.308246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c0a5-2719-4642-b628-8f592c177568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:19.309958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c0a5-2719-4642-b628-8f592c177568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:19.310333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c0a5-2719-4642-b628-8f592c177568 admin admin] PATH_INFO: `/v3/projects/11ee6ac9b4c84e7c9354901397aaea45/users/bd0f0a4d7b7d471cb10f99f1efd1a942/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:19.320640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2c0a5-2719-4642-b628-8f592c177568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ee6ac9b4c84e7c9354901397aaea45, user_id=bd0f0a4d7b7d471cb10f99f1efd1a942, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:19.333665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2c0a5-2719-4642-b628-8f592c177568 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:19.383164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 819/1636] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:19 2022] PUT /identity/v3/projects/11ee6ac9b4c84e7c9354901397aaea45/users/bd0f0a4d7b7d471cb10f99f1efd1a942/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:30:22.162168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:22.180055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de60262-c71e-4dfc-84bb-3c2459285902 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:22.389098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:22.390188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:22.390188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:22.390480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] PATH_INFO: `/v3/users/afcc52b05d414578a880e78944a7d7a7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:22.393262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afcc52b05d414578a880e78944a7d7a7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:22.395672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:22.567443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afcc52b05d414578a880e78944a7d7a7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:22.614261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afcc52b05d414578a880e78944a7d7a7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:22.647584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afcc52b05d414578a880e78944a7d7a7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:22.648616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afcc52b05d414578a880e78944a7d7a7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:22.649358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e9c99b6c-f97d-49c6-b2be-20d445fd3f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afcc52b05d414578a880e78944a7d7a7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:22.690996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 818/1637] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:22 2022] DELETE /identity/v3/users/afcc52b05d414578a880e78944a7d7a7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:22.693910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:22.694431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:22.694513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:22.739947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:22.741439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:22.804647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:22.805382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:22.805382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:22.887772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] MFA Rules not processed for user `bd0f0a4d7b7d471cb10f99f1efd1a942`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:22.889229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:22.933478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 820/1638] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:22.957433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:22.958812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:22.959191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:22.987878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:23.104033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e57d0-1768-4d62-a249-4a58e586d88a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:23.108930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 819/1639] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:23.115682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14295f-c091-4d5a-b34d-10ae3b598d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:23.116952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14295f-c091-4d5a-b34d-10ae3b598d35 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:23.117428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14295f-c091-4d5a-b34d-10ae3b598d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:23.118143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14295f-c091-4d5a-b34d-10ae3b598d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:23.153566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14295f-c091-4d5a-b34d-10ae3b598d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:23.161029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14295f-c091-4d5a-b34d-10ae3b598d35 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:23.198064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 821/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:24.765562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:24.767824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:24.795177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04535df-83e4-4c83-8165-3b0527ba32ac None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:24.809216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:24.811244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:24.813027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:24.815178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] PATH_INFO: `/v3/projects/598fa5694fc64cc58de07b1a29d19eb6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:24.821092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=598fa5694fc64cc58de07b1a29d19eb6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:24.823914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: WARNING py.warnings [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:30:24.823914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: warnings.warn(msg) Sep 15 07:30:24.823914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: Sep 15 07:30:24.832949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:24.970768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598fa5694fc64cc58de07b1a29d19eb6', 'request_id': 'req-a3adfc75-da80-4093-8dba-4ea389ff7a2b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:24.999263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598fa5694fc64cc58de07b1a29d19eb6', 'request_id': 'req-a3adfc75-da80-4093-8dba-4ea389ff7a2b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.006994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598fa5694fc64cc58de07b1a29d19eb6', 'request_id': 'req-a3adfc75-da80-4093-8dba-4ea389ff7a2b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.076203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] The token cache is being invalidate because project 598fa5694fc64cc58de07b1a29d19eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:25.077680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.085412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3adfc75-da80-4093-8dba-4ea389ff7a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.088492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 820/1641] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:24 2022] DELETE /identity/v3/projects/598fa5694fc64cc58de07b1a29d19eb6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:25.093926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5a93-a111-4de6-b9b4-736e26783bc9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:25.094449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5a93-a111-4de6-b9b4-736e26783bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:25.094449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5a93-a111-4de6-b9b4-736e26783bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:25.131564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3e4e5a93-a111-4de6-b9b4-736e26783bc9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:25.135072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3e4e5a93-a111-4de6-b9b4-736e26783bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:25.270000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 822/1642] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:25.280263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664aae3-ded7-47fc-85ed-a35310283c7d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:25.280622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664aae3-ded7-47fc-85ed-a35310283c7d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:25.281028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664aae3-ded7-47fc-85ed-a35310283c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:25.344456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e664aae3-ded7-47fc-85ed-a35310283c7d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:25.348374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e664aae3-ded7-47fc-85ed-a35310283c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:25.382002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e5a93-a111-4de6-b9b4-736e26783bc9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:25.382194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 821/1643] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:25.396810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e5a93-a111-4de6-b9b4-736e26783bc9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:25.422180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:25.426876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:25.452837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:25.453878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:25.465349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:25.467026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:25.470767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:25.524063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 823/1644] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:30:25.529698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664aae3-ded7-47fc-85ed-a35310283c7d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:25.548525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664aae3-ded7-47fc-85ed-a35310283c7d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:25.559546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:25.560414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:25.563669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:25.564150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:25.569339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:25.580799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:25.601624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:25.601624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:25.634017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bf016-3aa0-4210-bca6-ee448cdd156e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:25.666350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:25.673481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:25.675133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:25.676638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] PATH_INFO: `/v3/users/d0c237c7eef746ee9cf9b4269a41afad` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:25.688110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 822/1645] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:25 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:25.694205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:25.708523 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c237c7eef746ee9cf9b4269a41afad)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:25.712588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: WARNING py.warnings [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 07:30:25.712588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: warnings.warn(msg) Sep 15 07:30:25.712588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: Sep 15 07:30:25.721882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:25.864304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab108d4-b1fc-45fa-bd85-c203cbf5cd27 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:25.871229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5f9f5-88a2-41ef-8d45-e4729bf00d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:25.872715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f9f5-88a2-41ef-8d45-e4729bf00d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:25.873129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f9f5-88a2-41ef-8d45-e4729bf00d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:25.873513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f9f5-88a2-41ef-8d45-e4729bf00d9b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:25.874447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5f9f5-88a2-41ef-8d45-e4729bf00d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:25.878749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5f9f5-88a2-41ef-8d45-e4729bf00d9b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:25.901109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c237c7eef746ee9cf9b4269a41afad'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.920525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 823/1646] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:25 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:25.922577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b36e9b-d82a-4195-ba52-b77fa2075d9a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:25.924688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b36e9b-d82a-4195-ba52-b77fa2075d9a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:25.926131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b36e9b-d82a-4195-ba52-b77fa2075d9a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:25.927188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c237c7eef746ee9cf9b4269a41afad'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.928051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c237c7eef746ee9cf9b4269a41afad'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.928734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c237c7eef746ee9cf9b4269a41afad'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.931895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 824/1647] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:30:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:25.934116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b36e9b-d82a-4195-ba52-b77fa2075d9a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:25.939726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-32b36e9b-d82a-4195-ba52-b77fa2075d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:25.955595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c237c7eef746ee9cf9b4269a41afad'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:25.997088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b36e9b-d82a-4195-ba52-b77fa2075d9a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:26.006996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48ab0-7c7e-48ac-b0e9-61577464e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:26.007950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48ab0-7c7e-48ac-b0e9-61577464e6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.008205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48ab0-7c7e-48ac-b0e9-61577464e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.008579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48ab0-7c7e-48ac-b0e9-61577464e6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.009348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48ab0-7c7e-48ac-b0e9-61577464e6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:26.013988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48ab0-7c7e-48ac-b0e9-61577464e6fb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:26.022707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:26.051102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 825/1648] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:26.055908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0049-81ca-4aa0-b0ca-796aca2a6983 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.065951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0049-81ca-4aa0-b0ca-796aca2a6983 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.065951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b0049-81ca-4aa0-b0ca-796aca2a6983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.072639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 824/1649] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:25 2022] DELETE /identity/v3/users/d0c237c7eef746ee9cf9b4269a41afad => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:26.073602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:26.113594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-049b0049-81ca-4aa0-b0ca-796aca2a6983 None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:26.115300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-049b0049-81ca-4aa0-b0ca-796aca2a6983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:26.140010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:26.267941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 826/1650] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:30:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:26.269782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.270230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.270789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.316152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7081-dcdd-4e10-a719-0e6f7aeff490 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:26.316291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:26.320308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:26.327909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:26.328572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.328851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.329233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.329907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:26.331859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:26.345910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 827/1651] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:26.346694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:26.354798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:26.361438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 825/1652] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:26.366375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:26.385439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ed320-6f45-4397-ab84-7a867ace99bc admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:26.386741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad90c-a40b-45da-8b6b-e089e1530cca None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:26.395818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:26.396530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.396802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.397066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] PATH_INFO: `/v3/projects/bd54211e95684822adc686d9a3314403/users/d05246cbe63e42cca2e72bd9bea65d73/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.402215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a578fc-cdd7-47bd-bb72-37ffa47511e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:26.403487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a578fc-cdd7-47bd-bb72-37ffa47511e4 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.403785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a578fc-cdd7-47bd-bb72-37ffa47511e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.404052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a578fc-cdd7-47bd-bb72-37ffa47511e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.421590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a578fc-cdd7-47bd-bb72-37ffa47511e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:26.428008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a578fc-cdd7-47bd-bb72-37ffa47511e4 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:26.431607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54211e95684822adc686d9a3314403, user_id=d05246cbe63e42cca2e72bd9bea65d73, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:26.440588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:26.454952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 828/1653] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:26.467175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 826/1654] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:26 2022] PUT /identity/v3/projects/bd54211e95684822adc686d9a3314403/users/d05246cbe63e42cca2e72bd9bea65d73/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:26.478757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4bca-0f60-45fc-8a79-1ca44a96894b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.479111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4bca-0f60-45fc-8a79-1ca44a96894b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.479384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4bca-0f60-45fc-8a79-1ca44a96894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.489463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:26.494064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:26.566004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f97b4bca-0f60-45fc-8a79-1ca44a96894b None None] MFA Rules not processed for user `d05246cbe63e42cca2e72bd9bea65d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:26.570218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f97b4bca-0f60-45fc-8a79-1ca44a96894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:26.722469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66899c39-a190-4190-8ae0-20fe20b54f5d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:26.735319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:26.742512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:26.743146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:26.743574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:26.828890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 829/1655] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:26.831703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b4bca-0f60-45fc-8a79-1ca44a96894b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:26.927784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:26.941900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:26.995031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 827/1656] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:27.047936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b4bca-0f60-45fc-8a79-1ca44a96894b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:27.064246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:27.066672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:27.069470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:27.073899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:27.078140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:27.088679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:27.113868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:27.185601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 830/1657] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:26 2022] POST /identity/v3/projects => generated 367 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:27.188461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:27.204831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531a682-9af3-498b-a5d5-fcdbb9d81184 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:27.361962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:27.398989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:27.400401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:27.400861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:27.401306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:27.402125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:27.408802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:27.459791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 828/1658] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:27 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:27.463182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:27.480070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9171-1f20-42d4-8cd7-93bd31daf03e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:27.493371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:27.494031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:27.496568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:27.496850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:27.498743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:27.512736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:27.562471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 831/1659] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:27.563866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:27.603495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c677a86-45fc-4c51-b821-4c9421e04040 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:27.630409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:27.633554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:27.634551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:27.635570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] PATH_INFO: `/v3/projects/818738ee45d64d01a7cb2a87c12fc643/users/b963126dbc33480ba207287ef8b0e4be/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:27.697498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=818738ee45d64d01a7cb2a87c12fc643, user_id=b963126dbc33480ba207287ef8b0e4be, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:27.700423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:27.732724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 829/1660] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:27 2022] PUT /identity/v3/projects/818738ee45d64d01a7cb2a87c12fc643/users/b963126dbc33480ba207287ef8b0e4be/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:27.733295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:27.744368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346abb-eff6-4302-a746-1e5c3b247064 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:27.891704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab967b-898a-4f1e-b66f-75b3dfd0d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:27.892344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab967b-898a-4f1e-b66f-75b3dfd0d28e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:27.892676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab967b-898a-4f1e-b66f-75b3dfd0d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:27.892947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab967b-898a-4f1e-b66f-75b3dfd0d28e admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:27.893609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab967b-898a-4f1e-b66f-75b3dfd0d28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:27.895281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab967b-898a-4f1e-b66f-75b3dfd0d28e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:27.910056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 832/1661] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:30:27.914027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:27.930468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800dc7a-d0d5-46e2-b846-1cdafcb6ca2a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:27.947603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:27.948648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:27.949127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:27.949578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] PATH_INFO: `/v3/projects/818738ee45d64d01a7cb2a87c12fc643/users/b963126dbc33480ba207287ef8b0e4be/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:27.954511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=818738ee45d64d01a7cb2a87c12fc643, user_id=b963126dbc33480ba207287ef8b0e4be, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:27.957519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:27.988840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:27.989133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:27.989411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:27.999015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 830/1662] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:27 2022] PUT /identity/v3/projects/818738ee45d64d01a7cb2a87c12fc643/users/b963126dbc33480ba207287ef8b0e4be/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:28.048833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] MFA Rules not processed for user `b963126dbc33480ba207287ef8b0e4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:28.051037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:28.179974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 833/1663] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:28.202583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:28.204503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:28.420624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472b751-4f7f-4b4e-bc55-de81542c82fa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:28.449905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:28.458119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:28.458709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:28.459231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:28.487474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:28.489127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:28.512506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 831/1664] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:29.187525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:29.190133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:29.350503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:29.362114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbaed3-75b8-47d1-8694-9d7285fe54e7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:29.373588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:29.374336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:29.374739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:29.375037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] PATH_INFO: `/v3/users/445e5c56aac147988c83825075678d44` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:29.379520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445e5c56aac147988c83825075678d44)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:29.381627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:29.492720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445e5c56aac147988c83825075678d44'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.502430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:29.504324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:29.511222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445e5c56aac147988c83825075678d44'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.531569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445e5c56aac147988c83825075678d44'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.532626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445e5c56aac147988c83825075678d44'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.535234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445e5c56aac147988c83825075678d44'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.538533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78f5b-88be-4f2b-9fcd-59239cab2925 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:29.558913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:29.559581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:29.559859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:29.560129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] PATH_INFO: `/v3/users/e7bde5a9cc43477696f27d84a21467ed` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:29.562784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bde5a9cc43477696f27d84a21467ed)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:29.564780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:29.567801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 834/1665] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:29 2022] DELETE /identity/v3/users/445e5c56aac147988c83825075678d44 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:29.726733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bde5a9cc43477696f27d84a21467ed'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.747859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bde5a9cc43477696f27d84a21467ed'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.749392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bde5a9cc43477696f27d84a21467ed'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.750393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bde5a9cc43477696f27d84a21467ed'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.769283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:29.771424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:29.773744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0e2dde4a-626e-40fe-b23b-3008199a86df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bde5a9cc43477696f27d84a21467ed'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:29.839101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 832/1666] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:29 2022] DELETE /identity/v3/users/e7bde5a9cc43477696f27d84a21467ed => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:29.844709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:29.845170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:29.845768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:29.867491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:29.891975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:29.896218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:29.940041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec90cac-c38d-43d7-9294-f45ea538e164 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:30.047971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:30.048915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:30.051296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:30.051751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] PATH_INFO: `/v3/projects/406a6caacd5340c29a22dc598ac6143e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:30.054284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=406a6caacd5340c29a22dc598ac6143e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:30.060564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:30.097395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 833/1667] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:30:30.143935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:30.188388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406a6caacd5340c29a22dc598ac6143e', 'request_id': 'req-baf42a56-554d-4dcb-b525-8ecfce0001ad'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:30.216665 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406a6caacd5340c29a22dc598ac6143e', 'request_id': 'req-baf42a56-554d-4dcb-b525-8ecfce0001ad'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:30.224765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406a6caacd5340c29a22dc598ac6143e', 'request_id': 'req-baf42a56-554d-4dcb-b525-8ecfce0001ad'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:30.239979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:30.241714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:30.262312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] The token cache is being invalidate because project 406a6caacd5340c29a22dc598ac6143e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:30.265713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:30.266470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-baf42a56-554d-4dcb-b525-8ecfce0001ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:30.277248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 835/1668] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:29 2022] DELETE /identity/v3/projects/406a6caacd5340c29a22dc598ac6143e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:30:30.285179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95303e54-6640-4c52-a88a-2a0d8b2ad911 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:30.285468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95303e54-6640-4c52-a88a-2a0d8b2ad911 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:30.285742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95303e54-6640-4c52-a88a-2a0d8b2ad911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:30.351132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-95303e54-6640-4c52-a88a-2a0d8b2ad911 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:30.355069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-95303e54-6640-4c52-a88a-2a0d8b2ad911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:30.429213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f4b3b-093a-458e-a212-ffda1b1b23bc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:30.542384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 836/1669] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:30.543932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca222-fa3e-426d-92ed-dad2be5203ac None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:30.544200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca222-fa3e-426d-92ed-dad2be5203ac None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:30.544493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca222-fa3e-426d-92ed-dad2be5203ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:30.574036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:30.574756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:30.575194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:30.575796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:30.579481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:30.613493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:30.616484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:30.628155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0d3ca222-fa3e-426d-92ed-dad2be5203ac None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:30.630891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0d3ca222-fa3e-426d-92ed-dad2be5203ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:30.647164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 834/1670] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:30.662508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 837/1671] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:30.666998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:30.681236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed55ed-9439-4064-86ad-63940dadeddc service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:30.695757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:30.696409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:30.696684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:30.696953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:30.697610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:30.718025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:30.725111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:30.768419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 835/1672] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:30.769941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca222-fa3e-426d-92ed-dad2be5203ac None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:30.782551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca222-fa3e-426d-92ed-dad2be5203ac None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:30.795701 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b6cba-79d9-4926-bbd6-6d2e31357861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:30.796345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6cba-79d9-4926-bbd6-6d2e31357861 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:30.796838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6cba-79d9-4926-bbd6-6d2e31357861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:30.797113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6cba-79d9-4926-bbd6-6d2e31357861 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:30.798982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b6cba-79d9-4926-bbd6-6d2e31357861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:30.804371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b6cba-79d9-4926-bbd6-6d2e31357861 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:30.869488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 838/1673] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:30 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:30:30.871122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:30.884368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c0c82-7a4f-40cc-8631-9096706897be admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:30.970794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20908748-d723-43b9-b97c-055704245da9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:30.971399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20908748-d723-43b9-b97c-055704245da9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:30.971514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20908748-d723-43b9-b97c-055704245da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:31.015745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:31.050744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:31.051544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:31.057563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:31.058291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:31.059891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:31.061696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:31.065123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-20908748-d723-43b9-b97c-055704245da9 None None] MFA Rules not processed for user `92087877ad074bee9655c1a55fb5ba71`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:31.066371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-20908748-d723-43b9-b97c-055704245da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:31.142640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 836/1674] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:30 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:31.143756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:31.175424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a2219-7f63-4d20-a986-8ba007d15c76 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:31.190774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:31.191706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:31.192176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:31.192583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:31.193393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:31.195310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:31.226991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 837/1675] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:31.229551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:31.259775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393fe3-e3d4-4650-b476-495fed5ca32a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:31.275647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5622d-66e0-4dd7-8d5f-55c2c634d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:31.277838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5622d-66e0-4dd7-8d5f-55c2c634d74e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:31.279713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5622d-66e0-4dd7-8d5f-55c2c634d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:31.281927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5622d-66e0-4dd7-8d5f-55c2c634d74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:31.283266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5622d-66e0-4dd7-8d5f-55c2c634d74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:31.292640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5622d-66e0-4dd7-8d5f-55c2c634d74e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:31.322229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 839/1676] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:31.324289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 838/1677] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:31.326213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20908748-d723-43b9-b97c-055704245da9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:31.333552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-20908748-d723-43b9-b97c-055704245da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:31.335711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539d8a-8019-4117-88be-5707df4f45c5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:31.336070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539d8a-8019-4117-88be-5707df4f45c5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:31.336413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539d8a-8019-4117-88be-5707df4f45c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:31.369520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20908748-d723-43b9-b97c-055704245da9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:31.376325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:31.377582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:31.378183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:31.378633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] PATH_INFO: `/v3/projects/533d9fdb402949a4b3146567e19e17fe` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:31.380274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533d9fdb402949a4b3146567e19e17fe)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:31.383399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:31.407232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:31.409988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-89539d8a-8019-4117-88be-5707df4f45c5 None None] MFA Rules not processed for user `92087877ad074bee9655c1a55fb5ba71`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:31.415908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-89539d8a-8019-4117-88be-5707df4f45c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:31.447608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 839/1678] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:31.447608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89539d8a-8019-4117-88be-5707df4f45c5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:31.491617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89539d8a-8019-4117-88be-5707df4f45c5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:31.534295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533d9fdb402949a4b3146567e19e17fe', 'request_id': 'req-8daca6b4-f3c2-4273-961c-f20dd20f3c79'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:31.554067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533d9fdb402949a4b3146567e19e17fe', 'request_id': 'req-8daca6b4-f3c2-4273-961c-f20dd20f3c79'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:31.567370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533d9fdb402949a4b3146567e19e17fe', 'request_id': 'req-8daca6b4-f3c2-4273-961c-f20dd20f3c79'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:31.613083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] The token cache is being invalidate because project 533d9fdb402949a4b3146567e19e17fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:31.615180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:31.619031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:31.629556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 840/1679] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:31 2022] DELETE /identity/v3/projects/533d9fdb402949a4b3146567e19e17fe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:31.629556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:31.634605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:31.691309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:31.695623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:31.696968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:31.696968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] PATH_INFO: `/v3/projects/2d8b47d7b1aa4048a492390468abb55a/users/6d5ae34cb50540d48c87ce81e3a0cb6d/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:31.735113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8b47d7b1aa4048a492390468abb55a, user_id=6d5ae34cb50540d48c87ce81e3a0cb6d, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:31.738329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:31.772940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 840/1680] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:31 2022] PUT /identity/v3/projects/2d8b47d7b1aa4048a492390468abb55a/users/6d5ae34cb50540d48c87ce81e3a0cb6d/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:31.774116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:31.784415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:31.890434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daca6b4-f3c2-4273-961c-f20dd20f3c79 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:32.010173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888a49-1b87-430b-bfd7-5992c034190c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:32.030773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:32.031500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:32.031778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:32.032055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] PATH_INFO: `/v3/users/d05246cbe63e42cca2e72bd9bea65d73` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:32.037585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05246cbe63e42cca2e72bd9bea65d73)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:32.046358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:32.123592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72932d5-2666-4b79-9943-7e5f4d135d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:32.124259 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72932d5-2666-4b79-9943-7e5f4d135d25 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:32.124536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72932d5-2666-4b79-9943-7e5f4d135d25 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:32.124798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72932d5-2666-4b79-9943-7e5f4d135d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:32.133457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c72932d5-2666-4b79-9943-7e5f4d135d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:32.203883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:32.245107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05246cbe63e42cca2e72bd9bea65d73'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.267603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05246cbe63e42cca2e72bd9bea65d73'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.267848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05246cbe63e42cca2e72bd9bea65d73'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.269042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05246cbe63e42cca2e72bd9bea65d73'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.293426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:32.297870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05246cbe63e42cca2e72bd9bea65d73'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.355534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 841/1681] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:31 2022] DELETE /identity/v3/users/d05246cbe63e42cca2e72bd9bea65d73 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:32.355534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:32.358634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:32.405128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72932d5-2666-4b79-9943-7e5f4d135d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:32.406764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72932d5-2666-4b79-9943-7e5f4d135d25 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:32.443839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 841/1682] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:32.445182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39459c5a-1b4d-46a2-863a-07baf59e9697 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:32.445466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39459c5a-1b4d-46a2-863a-07baf59e9697 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:32.451232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39459c5a-1b4d-46a2-863a-07baf59e9697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:32.544921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-39459c5a-1b4d-46a2-863a-07baf59e9697 None None] MFA Rules not processed for user `6d5ae34cb50540d48c87ce81e3a0cb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:32.545493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-39459c5a-1b4d-46a2-863a-07baf59e9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:32.636888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523074-d494-4732-8416-5a99a5227d61 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:32.657593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:32.659278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:32.663259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:32.663551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] PATH_INFO: `/v3/users/bd0f0a4d7b7d471cb10f99f1efd1a942` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:32.667603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0f0a4d7b7d471cb10f99f1efd1a942)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:32.669605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:32.799888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 842/1683] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:32.799888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:32.803141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:32.803758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:32.819837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0f0a4d7b7d471cb10f99f1efd1a942'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.841027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0f0a4d7b7d471cb10f99f1efd1a942'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.842082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0f0a4d7b7d471cb10f99f1efd1a942'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.845923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0f0a4d7b7d471cb10f99f1efd1a942'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.855422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:32.856949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:32.862279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0f0a4d7b7d471cb10f99f1efd1a942'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:32.884946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 843/1684] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:32.886076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:32.890346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:32.909748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 842/1685] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:32 2022] DELETE /identity/v3/users/bd0f0a4d7b7d471cb10f99f1efd1a942 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:32.910996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:32.914811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:32.924053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa7da-c023-45e7-97cb-1ac1bd8d68af None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.003387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:33.076236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1ed04-80be-4880-b90e-9b21ea232a2c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.091625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.094152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.096560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.096560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.096785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.101570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.114109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.114776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.115104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.115337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] PATH_INFO: `/v3/projects/cc9d7aabb5144ebbb94d21373e1ab166` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.119315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9d7aabb5144ebbb94d21373e1ab166)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.121378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.190193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 843/1686] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:32 2022] POST /identity/v3/projects => generated 363 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:33.192544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.195922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:33.254319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9d7aabb5144ebbb94d21373e1ab166', 'request_id': 'req-3c6a63fb-eca8-472b-9746-ff161c2592c3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:33.270085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9d7aabb5144ebbb94d21373e1ab166', 'request_id': 'req-3c6a63fb-eca8-472b-9746-ff161c2592c3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:33.272918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:33.279163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9d7aabb5144ebbb94d21373e1ab166', 'request_id': 'req-3c6a63fb-eca8-472b-9746-ff161c2592c3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:33.306926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] The token cache is being invalidate because project cc9d7aabb5144ebbb94d21373e1ab166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:33.307341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:33.308836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:33.309775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 844/1687] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:32 2022] DELETE /identity/v3/projects/cc9d7aabb5144ebbb94d21373e1ab166 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:33.314217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.318387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:33.323690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3d261-64c3-4829-8f0e-df495c259415 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.472038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca97fc6-14f2-4b0a-a90a-c936bdc1d523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.472860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca97fc6-14f2-4b0a-a90a-c936bdc1d523 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.473144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca97fc6-14f2-4b0a-a90a-c936bdc1d523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.473529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca97fc6-14f2-4b0a-a90a-c936bdc1d523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.477445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0ca97fc6-14f2-4b0a-a90a-c936bdc1d523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:33.485542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a63fb-eca8-472b-9746-ff161c2592c3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.495670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca97fc6-14f2-4b0a-a90a-c936bdc1d523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.497645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca97fc6-14f2-4b0a-a90a-c936bdc1d523 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.501925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.502580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.502899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.503183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.503836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.505922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.514596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 844/1688] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:33.516460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3030b-7b0e-4dff-8b2a-a07e3d7d2f06 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.516460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3030b-7b0e-4dff-8b2a-a07e3d7d2f06 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.516649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3030b-7b0e-4dff-8b2a-a07e3d7d2f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.556005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9ee3030b-7b0e-4dff-8b2a-a07e3d7d2f06 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:33.557262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ee3030b-7b0e-4dff-8b2a-a07e3d7d2f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:33.572745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 845/1689] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:33 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:33.578053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.595061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 845/1690] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:33.598093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632884-4e4c-4b5b-8d4a-f681135d50f4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.599028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632884-4e4c-4b5b-8d4a-f681135d50f4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.599502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632884-4e4c-4b5b-8d4a-f681135d50f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.604602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a360e-a316-442b-abdf-2c476191c047 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.628531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-97632884-4e4c-4b5b-8d4a-f681135d50f4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:33.631320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97632884-4e4c-4b5b-8d4a-f681135d50f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:33.651567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 846/1691] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:33.652999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.653645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.653924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.655025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.655025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.656008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97632884-4e4c-4b5b-8d4a-f681135d50f4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.656675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.673324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97632884-4e4c-4b5b-8d4a-f681135d50f4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.692352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.693275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.693629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.694201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.694308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 846/1692] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:30:33.698198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:33.699015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.701590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.702040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.723943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba939ea-5b97-49de-baa8-85a5d20a35d5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.737247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 847/1693] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:33.740368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.745949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.748843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.750534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.750534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] PATH_INFO: `/v3/projects/195940d16a844e538b590199b957ff45/users/300c5c77c0f8458c94210df31cbd85cb/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.770683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4538-40e3-47b4-946d-9062d77e3718 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:33.785627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:33.786548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:33.786975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:33.787326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:33.788796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.792376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195940d16a844e538b590199b957ff45, user_id=300c5c77c0f8458c94210df31cbd85cb, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:33.795875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.797736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:33.843708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 847/1694] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:33 2022] PUT /identity/v3/projects/195940d16a844e538b590199b957ff45/users/300c5c77c0f8458c94210df31cbd85cb/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:33.844829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.881822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 848/1695] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:33 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:33.887737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:33.986310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:34.051333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4950ea-b637-4260-ace5-d4ab215652e1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:34.091422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4b46-3b2a-4617-84a9-f003b783ef51 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:34.104613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:34.105373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.105560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.105797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.106653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:34.114026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:34.128406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:34.159192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd74172-0904-478f-b918-28d7048f060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:34.160440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74172-0904-478f-b918-28d7048f060b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.160924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74172-0904-478f-b918-28d7048f060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.161607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74172-0904-478f-b918-28d7048f060b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.162714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd74172-0904-478f-b918-28d7048f060b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:34.165495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd74172-0904-478f-b918-28d7048f060b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:34.187569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 848/1696] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:34.192843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738991d-ae90-406d-b4f2-8576472c38b2 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.195172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738991d-ae90-406d-b4f2-8576472c38b2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.196436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 849/1697] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:33 2022] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:34.200461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738991d-ae90-406d-b4f2-8576472c38b2 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.201451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:34.207196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 849/1698] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 15 07:30:34 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:34.209455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738991d-ae90-406d-b4f2-8576472c38b2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:34.240656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c75a0d-cbe3-4251-a698-f58c5bbc65b5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:34.241000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738991d-ae90-406d-b4f2-8576472c38b2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:34.250091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:34.250601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.250906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.251182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] PATH_INFO: `/v3/projects/195940d16a844e538b590199b957ff45/users/300c5c77c0f8458c94210df31cbd85cb/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.252960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509920f3-4119-4028-b691-71a937e20f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:34.253702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509920f3-4119-4028-b691-71a937e20f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.254081 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509920f3-4119-4028-b691-71a937e20f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.254765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509920f3-4119-4028-b691-71a937e20f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.255563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509920f3-4119-4028-b691-71a937e20f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:34.260340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509920f3-4119-4028-b691-71a937e20f33 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:34.260560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195940d16a844e538b590199b957ff45, user_id=300c5c77c0f8458c94210df31cbd85cb, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:34.263285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:34.296567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 850/1699] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:34.299046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 850/1700] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:34 2022] PUT /identity/v3/projects/195940d16a844e538b590199b957ff45/users/300c5c77c0f8458c94210df31cbd85cb/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:34.302029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:34.313976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.315106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.315839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.405221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] MFA Rules not processed for user `9308f360df864174967889252718bc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:34.406747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:34.481215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ddcc3-0b08-4680-ba29-e34d5c71bce8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:34.489007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0781b-0f8f-437a-bc43-e9625565b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:34.493090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0781b-0f8f-437a-bc43-e9625565b44b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.493740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0781b-0f8f-437a-bc43-e9625565b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.494158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0781b-0f8f-437a-bc43-e9625565b44b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.495157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0781b-0f8f-437a-bc43-e9625565b44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:34.497939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0781b-0f8f-437a-bc43-e9625565b44b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:34.517302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 851/1701] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:34.517302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbf6f4-6824-46cd-a9a8-3972377e6547 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.517302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbf6f4-6824-46cd-a9a8-3972377e6547 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.517302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbf6f4-6824-46cd-a9a8-3972377e6547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.631971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f6cbf6f4-6824-46cd-a9a8-3972377e6547 None None] MFA Rules not processed for user `300c5c77c0f8458c94210df31cbd85cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:34.633873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f6cbf6f4-6824-46cd-a9a8-3972377e6547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:34.701714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 851/1702] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:30:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:34.702396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:34.715106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:34.778352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197ded-c519-4a37-8d5a-ad365ad9ed1a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:34.805516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:34.810785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.815283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.815576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] PATH_INFO: `/v3/projects/11ee6ac9b4c84e7c9354901397aaea45` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.822494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ee6ac9b4c84e7c9354901397aaea45)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:34.830797 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:34.841985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 852/1703] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:34.843211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbf6f4-6824-46cd-a9a8-3972377e6547 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:34.881131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbf6f4-6824-46cd-a9a8-3972377e6547 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:34.903544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:34.904679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:34.905758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:34.905758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] PATH_INFO: `/v3/projects/4a950b6d745743f1899c205ba60801f7/users/a087190cd18a4442a61c3fe1ed6d0f41/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:34.950385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a950b6d745743f1899c205ba60801f7, user_id=a087190cd18a4442a61c3fe1ed6d0f41, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:34.956504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:34.993636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 853/1704] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:34 2022] PUT /identity/v3/projects/4a950b6d745743f1899c205ba60801f7/users/a087190cd18a4442a61c3fe1ed6d0f41/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:34.993636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:35.006453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:35.017021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ee6ac9b4c84e7c9354901397aaea45', 'request_id': 'req-103b7f31-429b-4923-a681-6e8644eee021'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:35.018791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:35.032762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ee6ac9b4c84e7c9354901397aaea45', 'request_id': 'req-103b7f31-429b-4923-a681-6e8644eee021'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:35.049694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ee6ac9b4c84e7c9354901397aaea45', 'request_id': 'req-103b7f31-429b-4923-a681-6e8644eee021'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:35.071052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] The token cache is being invalidate because project 11ee6ac9b4c84e7c9354901397aaea45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:35.071373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:35.072537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:35.074924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 852/1705] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:34 2022] DELETE /identity/v3/projects/11ee6ac9b4c84e7c9354901397aaea45 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:35.079869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:35.081858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:35.234390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b7f31-429b-4923-a681-6e8644eee021 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:35.240893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9362f3-e820-4171-80fd-7bd36d152fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:35.246045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9362f3-e820-4171-80fd-7bd36d152fbc service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:35.246631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9362f3-e820-4171-80fd-7bd36d152fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:35.248724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9362f3-e820-4171-80fd-7bd36d152fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:35.250813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2ed2-e036-4953-9b56-b8cde92960b2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:35.262714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ff9362f3-e820-4171-80fd-7bd36d152fbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:35.284499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:35.426412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2391efd-4425-48a2-ab51-d7f3cb9c0799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:35.427264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2391efd-4425-48a2-ab51-d7f3cb9c0799 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:35.427541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2391efd-4425-48a2-ab51-d7f3cb9c0799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:35.427816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2391efd-4425-48a2-ab51-d7f3cb9c0799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:35.435218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e2391efd-4425-48a2-ab51-d7f3cb9c0799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:35.482928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2391efd-4425-48a2-ab51-d7f3cb9c0799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:35.492347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2391efd-4425-48a2-ab51-d7f3cb9c0799 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:35.537522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 854/1706] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:35.539136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130cf91-3983-4dd3-9989-f5553230cd09 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:35.539426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130cf91-3983-4dd3-9989-f5553230cd09 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:35.539704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130cf91-3983-4dd3-9989-f5553230cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:35.544771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9362f3-e820-4171-80fd-7bd36d152fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:35.549426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9362f3-e820-4171-80fd-7bd36d152fbc service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:35.584694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 853/1707] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:35.586501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3cdbe-dd28-4afb-98f7-a0c7b4cbacea None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:35.590425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3cdbe-dd28-4afb-98f7-a0c7b4cbacea None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:35.591140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3cdbe-dd28-4afb-98f7-a0c7b4cbacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:35.672258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b130cf91-3983-4dd3-9989-f5553230cd09 None None] MFA Rules not processed for user `ea21235f22f14e6f8e9649c65f8a683f`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:35.673763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4cb3cdbe-dd28-4afb-98f7-a0c7b4cbacea None None] MFA Rules not processed for user `a087190cd18a4442a61c3fe1ed6d0f41`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:35.674451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b130cf91-3983-4dd3-9989-f5553230cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:35.675315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4cb3cdbe-dd28-4afb-98f7-a0c7b4cbacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:35.934144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 855/1708] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:35.935330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245824-f1b6-452e-8124-100671c82357 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:35.938438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245824-f1b6-452e-8124-100671c82357 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:35.938763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245824-f1b6-452e-8124-100671c82357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:35.971012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 854/1709] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:35.981736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:35.982499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:35.987298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:36.030045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d2245824-f1b6-452e-8124-100671c82357 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:36.033487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] MFA Rules not processed for user `ea21235f22f14e6f8e9649c65f8a683f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:36.034978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d2245824-f1b6-452e-8124-100671c82357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:36.035743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:36.070029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 855/1710] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:36.072079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:36.083495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:36.182212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:36.229768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 856/1711] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:36.241381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246848-f0e3-463b-ba9b-b62d98439ddc None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:36.242559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246848-f0e3-463b-ba9b-b62d98439ddc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:36.244119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246848-f0e3-463b-ba9b-b62d98439ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:36.294975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-52246848-f0e3-463b-ba9b-b62d98439ddc None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:36.296478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-52246848-f0e3-463b-ba9b-b62d98439ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:36.318002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033908-4049-4311-8ac1-ccfc76c0db8a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:36.321989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 857/1712] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:36.323055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246848-f0e3-463b-ba9b-b62d98439ddc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:36.330108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:36.331303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:36.332470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:36.332865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:36.355482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246848-f0e3-463b-ba9b-b62d98439ddc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:36.356312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:36.362212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:36.368826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:36.370015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:36.370015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:36.370286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:36.371167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:36.371471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:36.373123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:36.409280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 856/1713] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:36.411238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:36.417874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:36.451676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 858/1714] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:36.461295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe71313-a5e3-4037-bf65-f986cc5ac86e service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:36.465422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:36.496960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:36.497520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:36.497795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:36.508592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b81d-f39a-4ccd-842b-7a15e3141a2b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:36.508798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] PATH_INFO: `/v3/projects/bd54211e95684822adc686d9a3314403` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:36.511767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd54211e95684822adc686d9a3314403)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:36.516992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:36.539516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:36.540482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:36.541016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:36.541557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:36.542551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:36.547256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:36.555486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:36.688685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 859/1715] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:36 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:36.689994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:36.772352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd54211e95684822adc686d9a3314403', 'request_id': 'req-1d47377c-1ef9-4de6-81d2-b12aed5eafce'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:36.811040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd54211e95684822adc686d9a3314403', 'request_id': 'req-1d47377c-1ef9-4de6-81d2-b12aed5eafce'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:36.828941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd54211e95684822adc686d9a3314403', 'request_id': 'req-1d47377c-1ef9-4de6-81d2-b12aed5eafce'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:36.890275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] The token cache is being invalidate because project bd54211e95684822adc686d9a3314403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:36.890798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:36.898187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:36.906401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 857/1716] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:36 2022] DELETE /identity/v3/projects/bd54211e95684822adc686d9a3314403 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:36.913680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:36.920060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:36.972759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805485-d11d-416f-8beb-cc8d678db1d9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:36.989054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:36.989914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:36.990617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:36.991438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:36.999759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:37.149628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47377c-1ef9-4de6-81d2-b12aed5eafce admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:37.212120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:37.217423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:37.249035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 860/1717] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:37.250108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:37.254402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:37.346172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:37.347235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:37.347696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:37.348293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:37.350462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:37.352682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:37.390725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 858/1718] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:36 2022] POST /identity/v3/users => generated 289 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:37.390725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:37.392840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:37.418690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661270-a5ca-45be-81dc-99d128904ffc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:37.425257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:37.433186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:37.434012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:37.434649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:37.435008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] PATH_INFO: `/v3/users/b963126dbc33480ba207287ef8b0e4be` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:37.437656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b963126dbc33480ba207287ef8b0e4be)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:37.441615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:37.468780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fc63d-4deb-41ee-985d-87ce149c11ae service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:37.480155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:37.483025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:37.483486 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:37.483825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] PATH_INFO: `/v3/users/6d5ae34cb50540d48c87ce81e3a0cb6d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:37.485680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5ae34cb50540d48c87ce81e3a0cb6d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:37.489094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:37.489255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:37.541655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b963126dbc33480ba207287ef8b0e4be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.563343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b963126dbc33480ba207287ef8b0e4be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.595234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b963126dbc33480ba207287ef8b0e4be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.596585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b963126dbc33480ba207287ef8b0e4be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.600036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7a241180-15a6-413f-9880-4b69c19081e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b963126dbc33480ba207287ef8b0e4be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.630135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5ae34cb50540d48c87ce81e3a0cb6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.641654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 859/1719] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:37 2022] DELETE /identity/v3/users/b963126dbc33480ba207287ef8b0e4be => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:37.641654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b97f2-ec43-4297-8bcf-c1bfd6c0c2f0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:37.642475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b97f2-ec43-4297-8bcf-c1bfd6c0c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:37.648261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b97f2-ec43-4297-8bcf-c1bfd6c0c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:37.655820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5ae34cb50540d48c87ce81e3a0cb6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.656436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5ae34cb50540d48c87ce81e3a0cb6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.657180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5ae34cb50540d48c87ce81e3a0cb6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.679426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5ae34cb50540d48c87ce81e3a0cb6d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:37.737863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 861/1720] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:37 2022] DELETE /identity/v3/users/6d5ae34cb50540d48c87ce81e3a0cb6d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:37.738992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:37.740742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:37.747927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-626b97f2-ec43-4297-8bcf-c1bfd6c0c2f0 None None] MFA Rules not processed for user `c0cb3d32205b485eb96d1de3f5e0749f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:37.749887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-626b97f2-ec43-4297-8bcf-c1bfd6c0c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:37.864570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086101a-0952-4856-b973-ea557b93c29e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:37.879445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:37.886498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:37.887035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:37.887315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:37.890790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:37.907410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:37.909295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:37.925585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 860/1721] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:37.925734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 862/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:37.925734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:37.927149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:37.933845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de70a5e-5d44-4107-b8d2-e3a78999cc30 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:37.933845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de70a5e-5d44-4107-b8d2-e3a78999cc30 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:37.933845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de70a5e-5d44-4107-b8d2-e3a78999cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.002914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3de70a5e-5d44-4107-b8d2-e3a78999cc30 None None] MFA Rules not processed for user `0e421a45c825416fa5bf4aec29ed0c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:38.005090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3de70a5e-5d44-4107-b8d2-e3a78999cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.076489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:38.087229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a88f4-43b2-4e62-9ecb-de57218e9ab8 service placement] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:38.111350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:38.112004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.112280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.113262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.114489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:38.123584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:38.149615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 863/1723] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:38.152281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:38.156036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.178727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 861/1724] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:38.178727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.178727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.178727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.179548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b1c6-5b1e-4495-ab42-68469e3a5439 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:38.184970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:38.185646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.185920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.186182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] PATH_INFO: `/v3/users/a087190cd18a4442a61c3fe1ed6d0f41` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.188510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a087190cd18a4442a61c3fe1ed6d0f41)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:38.191027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:38.224360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:38.227259 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.254020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 862/1725] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:38.258565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:38.260128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.309667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:38.321353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a087190cd18a4442a61c3fe1ed6d0f41'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.346203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a087190cd18a4442a61c3fe1ed6d0f41'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.347022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a087190cd18a4442a61c3fe1ed6d0f41'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.348011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a087190cd18a4442a61c3fe1ed6d0f41'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.359753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0893e23e-df82-41d5-8f5f-d22d13bd4f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a087190cd18a4442a61c3fe1ed6d0f41'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.400734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 864/1726] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:38 2022] DELETE /identity/v3/users/a087190cd18a4442a61c3fe1ed6d0f41 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:38.400734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a384f-d29d-4ecd-bea0-24622f5ca9d0 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.400734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a384f-d29d-4ecd-bea0-24622f5ca9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.402195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a384f-d29d-4ecd-bea0-24622f5ca9d0 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.407736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 865/1727] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 15 07:30:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:38.408870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a384f-d29d-4ecd-bea0-24622f5ca9d0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:38.413330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-de9a384f-d29d-4ecd-bea0-24622f5ca9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.454765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711f8d-b95a-46dd-b263-9b98e2d3f3a3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:38.532269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a384f-d29d-4ecd-bea0-24622f5ca9d0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:38.541799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:38.541989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.542257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.549587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.550942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:38.553678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:38.555128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:38.555955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.556108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.556604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.558315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.573522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 866/1728] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:38.574790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:38.577436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.596665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd62e8-7d25-4875-aca7-1303caea5a94 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:38.602637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:38.606042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.611066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.611517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] PATH_INFO: `/v3/projects/818738ee45d64d01a7cb2a87c12fc643` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.613771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=818738ee45d64d01a7cb2a87c12fc643)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:38.621186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:38.663354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:38.666762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:38.684457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 863/1729] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:38.685344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:38.687095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:38.724840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818738ee45d64d01a7cb2a87c12fc643', 'request_id': 'req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.732098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:38.734481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818738ee45d64d01a7cb2a87c12fc643', 'request_id': 'req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.750121 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818738ee45d64d01a7cb2a87c12fc643', 'request_id': 'req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.799101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] The token cache is being invalidate because project 818738ee45d64d01a7cb2a87c12fc643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:38.802434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.804803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5bc379d4-7d1f-4eb9-bfaa-8d64733b7cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:38.812088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 867/1730] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:38 2022] DELETE /identity/v3/projects/818738ee45d64d01a7cb2a87c12fc643 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:38.816103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364c22e-2f63-443c-a414-d91dd31e6f92 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:38.816734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364c22e-2f63-443c-a414-d91dd31e6f92 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:38.818162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364c22e-2f63-443c-a414-d91dd31e6f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:38.832162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076ffb3-2bae-4691-a729-8a05bb815630 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:38.851031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:38.899689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0364c22e-2f63-443c-a414-d91dd31e6f92 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:38.901922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0364c22e-2f63-443c-a414-d91dd31e6f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.034774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b80a0-9b1b-4f59-85d2-9de1ba82f271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:39.036975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b80a0-9b1b-4f59-85d2-9de1ba82f271 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:39.037480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b80a0-9b1b-4f59-85d2-9de1ba82f271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:39.037857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b80a0-9b1b-4f59-85d2-9de1ba82f271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:39.048404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0d8b80a0-9b1b-4f59-85d2-9de1ba82f271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.075725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 868/1731] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:39.080428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:39.081008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:39.081008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:39.129638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] MFA Rules not processed for user `9308f360df864174967889252718bc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:39.132075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.149132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 869/1732] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:30:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:39.149783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:39.158187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.193310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e1a6-efd0-4d90-963b-cfbab8ac7c28 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:39.211033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:39.211841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:39.212313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:39.212606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] PATH_INFO: `/v3/projects/6e2131929a4a4f37aff462700cbce7b0/users/ee8c5b28d91c4c7a9a92ddb14439a1ea/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:39.230955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b80a0-9b1b-4f59-85d2-9de1ba82f271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:39.232440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b80a0-9b1b-4f59-85d2-9de1ba82f271 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:39.249441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 864/1733] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:39.254759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:39.255103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:39.255271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2131929a4a4f37aff462700cbce7b0, user_id=ee8c5b28d91c4c7a9a92ddb14439a1ea, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:39.256628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:39.263030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:39.304236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 870/1734] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:39 2022] PUT /identity/v3/projects/6e2131929a4a4f37aff462700cbce7b0/users/ee8c5b28d91c4c7a9a92ddb14439a1ea/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:39.305374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:39.312588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.313164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:39.315763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.577066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 865/1735] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:39.577978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:39.585268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.649557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ea726-655b-4260-b5da-777750a980e9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:39.669916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9522f3-cab0-484e-8ff4-6c848e3cd481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:39.674956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9522f3-cab0-484e-8ff4-6c848e3cd481 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:39.682239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9522f3-cab0-484e-8ff4-6c848e3cd481 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:39.682469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9522f3-cab0-484e-8ff4-6c848e3cd481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:39.701274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bb9522f3-cab0-484e-8ff4-6c848e3cd481 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:39.830097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c580b5d-95a8-4835-a00d-88d963e7d06e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:39.834989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:39.838121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:39.845130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:39.845766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:39.889485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:39.893051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:39.902333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:39.918952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:39.947433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 866/1736] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:39.950764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:39.961562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9522f3-cab0-484e-8ff4-6c848e3cd481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:39.966450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9522f3-cab0-484e-8ff4-6c848e3cd481 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:39.979773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d31df-df1b-48a0-90dc-eae8cfd49c8a service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:39.991060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d09b79-48a3-4016-8af2-bc783248b56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:39.992907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09b79-48a3-4016-8af2-bc783248b56d service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:39.995053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09b79-48a3-4016-8af2-bc783248b56d service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:39.995566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09b79-48a3-4016-8af2-bc783248b56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.032036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d09b79-48a3-4016-8af2-bc783248b56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:40.034512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 871/1737] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:40.036102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2a5d-a775-44e7-9b10-20c7e63bb516 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:40.038591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d09b79-48a3-4016-8af2-bc783248b56d service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:40.040863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2a5d-a775-44e7-9b10-20c7e63bb516 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:40.044831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2a5d-a775-44e7-9b10-20c7e63bb516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.096147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 867/1738] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:40.103205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eb35c-91d1-4d3c-839c-61401c1bfcd2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:40.105514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eb35c-91d1-4d3c-839c-61401c1bfcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:40.107784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eb35c-91d1-4d3c-839c-61401c1bfcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.180435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3e8a2a5d-a775-44e7-9b10-20c7e63bb516 None None] MFA Rules not processed for user `ee8c5b28d91c4c7a9a92ddb14439a1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:40.184066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3e8a2a5d-a775-44e7-9b10-20c7e63bb516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:40.220458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-819eb35c-91d1-4d3c-839c-61401c1bfcd2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:40.221636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-819eb35c-91d1-4d3c-839c-61401c1bfcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:40.270013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 868/1739] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:40.274397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819eb35c-91d1-4d3c-839c-61401c1bfcd2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:40.344173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819eb35c-91d1-4d3c-839c-61401c1bfcd2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:40.358226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 872/1740] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:40.363354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2a5d-a775-44e7-9b10-20c7e63bb516 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:40.383767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:40.385348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:40.385645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:40.385913 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.386601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:40.392313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2a5d-a775-44e7-9b10-20c7e63bb516 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:40.400616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:40.404953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:40.406001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:40.406802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:40.410379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:40.410752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.411642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:40.418768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:40.501809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 869/1741] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:40.507177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:40.546492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 873/1742] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:40 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:40.550764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:40.564674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff8b9-a11d-4d2f-8fe8-67d4f65b4561 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:40.747692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14da82c-1845-4711-8d4e-54ad7cef1e23 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:40.760747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:40.763527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:40.764297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:40.764730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.765730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:40.768063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:40.822153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 874/1743] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:40 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:40.828502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:40.850125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:40.856880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:40.857090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:40.858110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.860656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:40.865956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:40.876257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96df79-a286-4c30-8743-1e449997f7b1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:40.896778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:40.899362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:40.900779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:40.901433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:40.904503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:40.909377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:40.929942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 875/1744] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:40.931396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:40.937386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:40.946639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 870/1745] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:40 2022] POST /identity/v3/projects => generated 387 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:40.947724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:40.973211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485dd2-1d1a-4cc5-82a9-ec94ffa45dbf admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:41.101538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:41.115931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01574b32-8b51-4add-b97a-5d7a02a308e2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:41.135058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:41.136107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:41.136382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:41.137124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] PATH_INFO: `/v3/projects/8e592a1087304b8f94990aeb9e89b7c1/users/5579fd5894aa426b9e7c435cef077692/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:41.174045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:41.175954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:41.187026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:41.187634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] PATH_INFO: `/v3/projects/2d8b47d7b1aa4048a492390468abb55a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:41.193631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e592a1087304b8f94990aeb9e89b7c1, user_id=5579fd5894aa426b9e7c435cef077692, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:41.194505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8b47d7b1aa4048a492390468abb55a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:41.203614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:41.211473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:41.266621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 871/1746] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:40 2022] PUT /identity/v3/projects/8e592a1087304b8f94990aeb9e89b7c1/users/5579fd5894aa426b9e7c435cef077692/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:41.267695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:41.356466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8b47d7b1aa4048a492390468abb55a', 'request_id': 'req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:41.374141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8b47d7b1aa4048a492390468abb55a', 'request_id': 'req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:41.395668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8b47d7b1aa4048a492390468abb55a', 'request_id': 'req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:41.397074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:41.428789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] The token cache is being invalidate because project 2d8b47d7b1aa4048a492390468abb55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:41.432890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:41.434508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:41.436148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 876/1747] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:40 2022] DELETE /identity/v3/projects/2d8b47d7b1aa4048a492390468abb55a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:41.439932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:41.442617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:41.487691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0107a72-252d-449d-8f2e-c61e2805142b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:41.721601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd2fd6-9425-4925-9c11-fbafdeb6e03b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:41.737345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:41.739674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:41.740706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:41.741900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:41.744498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:41.745095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:41.745843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:41.750035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:41.752190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:41.753851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:41.754428 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:41.759370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:41.796933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 877/1748] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:41.804047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:41.816049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:41.841631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 872/1749] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:41 2022] POST /identity/v3/users => generated 294 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:41.852447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:41.867329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131ecf-38e2-4628-aad1-77cef6732cd1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:41.872567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586aaa9-188e-44bb-9719-5486f5229097 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:41.878765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:41.879904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:41.881307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:41.882145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] PATH_INFO: `/v3/users/300c5c77c0f8458c94210df31cbd85cb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:41.886857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300c5c77c0f8458c94210df31cbd85cb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:41.887415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:41.888243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:41.890395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:41.890790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:41.891190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] PATH_INFO: `/v3/projects/8e592a1087304b8f94990aeb9e89b7c1/users/5579fd5894aa426b9e7c435cef077692/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:41.914174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e592a1087304b8f94990aeb9e89b7c1, user_id=5579fd5894aa426b9e7c435cef077692, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:41.928958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:41.987093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 873/1750] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:41 2022] PUT /identity/v3/projects/8e592a1087304b8f94990aeb9e89b7c1/users/5579fd5894aa426b9e7c435cef077692/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:41.990099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:42.001846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:42.096225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300c5c77c0f8458c94210df31cbd85cb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:42.119956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300c5c77c0f8458c94210df31cbd85cb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:42.120439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300c5c77c0f8458c94210df31cbd85cb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:42.121277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300c5c77c0f8458c94210df31cbd85cb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:42.124574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:42.141723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b713c67c-f0de-4dc7-9df3-5534c4ee1436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300c5c77c0f8458c94210df31cbd85cb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:42.201048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 878/1751] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:41 2022] DELETE /identity/v3/users/300c5c77c0f8458c94210df31cbd85cb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:42.209032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c4b7-3457-4541-8252-5e5ee06f315f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:42.210443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c4b7-3457-4541-8252-5e5ee06f315f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:42.211015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c4b7-3457-4541-8252-5e5ee06f315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:42.329090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b667c4b7-3457-4541-8252-5e5ee06f315f None None] MFA Rules not processed for user `5579fd5894aa426b9e7c435cef077692`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:42.337108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b667c4b7-3457-4541-8252-5e5ee06f315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:42.380895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4522-608a-4c57-8269-ed3bcb9c24d9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:42.623986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b5f74-5000-43d0-8cf0-efe649352ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:42.623986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b5f74-5000-43d0-8cf0-efe649352ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:42.623986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b5f74-5000-43d0-8cf0-efe649352ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:42.624804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b5f74-5000-43d0-8cf0-efe649352ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:42.629195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b5f74-5000-43d0-8cf0-efe649352ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:42.637087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b5f74-5000-43d0-8cf0-efe649352ff2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:42.657733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 879/1752] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:42.657733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:42.657733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:42.657733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:42.682325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 874/1753] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 692 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:42.683969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:42.685493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:42.686129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:42.708859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:42.746599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] MFA Rules not processed for user `ea21235f22f14e6f8e9649c65f8a683f`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:42.752059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:42.985687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:42.988736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:43.089783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 880/1754] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:43.098930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:43.106614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:43.307137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 875/1755] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:30:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 624 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:43.310280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:43.312425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:43.331490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac9d6f-1c86-41cd-8e5f-927c8ca95ad5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:43.346703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:43.363197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:43.368292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:43.369362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:43.378165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c980e-8ca0-4582-9fdc-13b20f677c06 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:43.395860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:43.398053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:43.400371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:43.400371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:43.407983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:43.409440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:43.412493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:43.413242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:43.476639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 881/1756] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:43.476849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 876/1757] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:43.482891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:43.483201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:43.487173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:43.545416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1d64f-357d-4b28-9ab9-34373316ea9d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:43.575738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:43.577451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8a859-83eb-4588-9c73-c1f1545a484e service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:43.578730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:43.579043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:43.579320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] PATH_INFO: `/v3/projects/99fb05eb9fa24f43b82ce076f9363ded/users/2c70487d64cb447799179e276b70c13b/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:43.659748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:43.663225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:43.664390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:43.667738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] PATH_INFO: `/v3/projects/4a950b6d745743f1899c205ba60801f7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:43.672208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a950b6d745743f1899c205ba60801f7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:43.690127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:43.697057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:43.742764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fb05eb9fa24f43b82ce076f9363ded, user_id=2c70487d64cb447799179e276b70c13b, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:43.769342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:43.818791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 877/1758] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:43 2022] PUT /identity/v3/projects/99fb05eb9fa24f43b82ce076f9363ded/users/2c70487d64cb447799179e276b70c13b/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:43.820515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:43.838475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:43.923355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a950b6d745743f1899c205ba60801f7', 'request_id': 'req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:43.955286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a950b6d745743f1899c205ba60801f7', 'request_id': 'req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:43.983402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a950b6d745743f1899c205ba60801f7', 'request_id': 'req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:44.032785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] The token cache is being invalidate because project 4a950b6d745743f1899c205ba60801f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:44.033423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:44.038139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:44.050302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 882/1759] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:43 2022] DELETE /identity/v3/projects/4a950b6d745743f1899c205ba60801f7 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:44.052296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:44.066220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:44.272099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e780710-0571-4d83-87f9-fe3a12ac9be7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:44.335359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0df09c-72f7-48ce-a0c1-8de94a2ee0a4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:44.351099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6795-3351-4493-b678-e2de47e79a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:44.355010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:44.356171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6795-3351-4493-b678-e2de47e79a0b service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:44.357353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6795-3351-4493-b678-e2de47e79a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:44.360554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6795-3351-4493-b678-e2de47e79a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:44.365542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-769f6795-3351-4493-b678-e2de47e79a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:44.593192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81fee4-ee0d-40c4-8548-04ddfba55376 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:44.593841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81fee4-ee0d-40c4-8548-04ddfba55376 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:44.594113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81fee4-ee0d-40c4-8548-04ddfba55376 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:44.594374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81fee4-ee0d-40c4-8548-04ddfba55376 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:44.603512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3e81fee4-ee0d-40c4-8548-04ddfba55376 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:44.618350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6795-3351-4493-b678-e2de47e79a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:44.622250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6795-3351-4493-b678-e2de47e79a0b service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:44.638638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 883/1760] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:44.651488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:44.651781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:44.652093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:44.753182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] MFA Rules not processed for user `2c70487d64cb447799179e276b70c13b`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:44.754458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:44.948332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:45.025643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81fee4-ee0d-40c4-8548-04ddfba55376 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:45.028145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81fee4-ee0d-40c4-8548-04ddfba55376 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:45.055063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 878/1761] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:30:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:30:45.061587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d4a9-d985-4496-bd14-acf8683c6a9e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.061587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d4a9-d985-4496-bd14-acf8683c6a9e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.061587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d4a9-d985-4496-bd14-acf8683c6a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.121645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3395d4a9-d985-4496-bd14-acf8683c6a9e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:45.123253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3395d4a9-d985-4496-bd14-acf8683c6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:45.160622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 884/1762] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:45.173618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.185197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:45.368017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a3f40-b540-4169-ab44-7099286617b4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:45.372111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 879/1763] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:45.380348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4043-2559-4db1-a836-f03262dd0bb7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.380765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4043-2559-4db1-a836-f03262dd0bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.381509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4043-2559-4db1-a836-f03262dd0bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.390359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:45.390732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.391146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.391427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.392085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:45.394160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:45.457160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-713d4043-2559-4db1-a836-f03262dd0bb7 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:45.458066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 885/1764] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:45 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:45.462277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-713d4043-2559-4db1-a836-f03262dd0bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:45.466360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.645590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6e29-945f-4ce1-9497-5df66eba1f09 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:45.660683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:45.661645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.662125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.662589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.663447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:45.665619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:45.691211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 880/1765] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:45.695321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4043-2559-4db1-a836-f03262dd0bb7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.702154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:45.706148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4043-2559-4db1-a836-f03262dd0bb7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:45.724864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:45.725738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.727033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.727545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.728407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:45.728718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:45.731489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:45.750893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 886/1766] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:45 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:45.750893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.771239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f917a1-e8d2-49e6-b2e0-aae0ff7a7c2d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:45.778389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 881/1767] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:30:45.779728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.791474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:45.792270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.792648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.793038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.793808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:45.799624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:45.805159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ad02-739b-4317-8b23-454512d06c75 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:45.816835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:45.818540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.818540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.819337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.820001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:45.823584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:45.834376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 887/1768] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:45.835530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.853426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a10ea1-ff7f-482f-988e-138dd0f20bed admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:45.867498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:45.868536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:45.869022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:45.869537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:45.870399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:45.872267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:45.903288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 888/1769] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:30:45.904348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.916106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 882/1770] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:45 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:45.922139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:45.929863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88b3be-faf0-463d-a19b-abc4c12127ed admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:45.981558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:46.044089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebbfd0-be0e-4b2b-863f-9174c0e51e89 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:46.053711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:46.054737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.055256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.056691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.058559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:46.059252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e26c-72c8-40fe-a992-061b19ca2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:46.060143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e26c-72c8-40fe-a992-061b19ca2795 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.060573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e26c-72c8-40fe-a992-061b19ca2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.060996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e26c-72c8-40fe-a992-061b19ca2795 admin admin] PATH_INFO: `/v3/projects/40696c0397d14f61aee176484fae050b/users/4112d0a3e5694fd29e4dd2db9f3a2519/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.078666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:46.104328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e26c-72c8-40fe-a992-061b19ca2795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40696c0397d14f61aee176484fae050b, user_id=4112d0a3e5694fd29e4dd2db9f3a2519, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:46.111711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e26c-72c8-40fe-a992-061b19ca2795 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:46.142048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 889/1771] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:45 2022] PUT /identity/v3/projects/40696c0397d14f61aee176484fae050b/users/4112d0a3e5694fd29e4dd2db9f3a2519/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:46.147959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 883/1772] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:45 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:46.167140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:46.175101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa236-63d0-4251-8289-2379ad63da85 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.175101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa236-63d0-4251-8289-2379ad63da85 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.175101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa236-63d0-4251-8289-2379ad63da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.197976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9795-7c43-4c8b-8b3d-ea0e7703ca70 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:46.275269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-280aa236-63d0-4251-8289-2379ad63da85 None None] MFA Rules not processed for user `4112d0a3e5694fd29e4dd2db9f3a2519`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:46.276945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-280aa236-63d0-4251-8289-2379ad63da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:46.410455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:46.411526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.413274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.413908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.414811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:46.424113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:46.479898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 884/1773] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:46.492675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:46.541493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0ab5d-2d49-4653-8476-7bbfa90e0d49 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:46.564470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:46.565660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.568024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.568541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.571546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:46.578257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:46.591857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 890/1774] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:46.596185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aa236-63d0-4251-8289-2379ad63da85 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:46.628167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aa236-63d0-4251-8289-2379ad63da85 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:46.638301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 885/1775] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:46.643987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:46.661564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:46.662122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.662417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.662670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.663352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:46.665295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:46.677306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe5e2-ab85-48a2-855f-fd8237533447 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:46.699976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35914736-1d6d-495a-982a-8d6a52f9b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:46.700671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914736-1d6d-495a-982a-8d6a52f9b913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.700954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914736-1d6d-495a-982a-8d6a52f9b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.701281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914736-1d6d-495a-982a-8d6a52f9b913 admin admin] PATH_INFO: `/v3/projects/344ccf02248a43d8a14e0075918a673d/users/ec617642090045cbb858d698e2a7010a/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.762327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 891/1776] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:46 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:46.763453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:46.785703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914736-1d6d-495a-982a-8d6a52f9b913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344ccf02248a43d8a14e0075918a673d, user_id=ec617642090045cbb858d698e2a7010a, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:46.788654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914736-1d6d-495a-982a-8d6a52f9b913 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:46.851488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 886/1777] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:46 2022] PUT /identity/v3/projects/344ccf02248a43d8a14e0075918a673d/users/ec617642090045cbb858d698e2a7010a/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:46.869539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5ede-add4-484b-bdd7-f344fd9a5a3f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:46.869981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5ede-add4-484b-bdd7-f344fd9a5a3f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:46.870384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5ede-add4-484b-bdd7-f344fd9a5a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:46.970140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-402b5ede-add4-484b-bdd7-f344fd9a5a3f None None] MFA Rules not processed for user `ec617642090045cbb858d698e2a7010a`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:46.976558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-402b5ede-add4-484b-bdd7-f344fd9a5a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:47.015218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:47.020132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41218e78-6885-470a-b0df-42124021a036 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:47.114841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:47.201439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 887/1778] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:47.203831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5ede-add4-484b-bdd7-f344fd9a5a3f None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:47.211462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:47.222774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:47.223161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:47.223484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:47.224169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:47.231140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:47.252653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5ede-add4-484b-bdd7-f344fd9a5a3f None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:47.278876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:47.281696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:47.281980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:47.282261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:47.282965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:47.295245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:47.308973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 892/1779] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:46 2022] POST /identity/v3/users => generated 300 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:47.315887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:47.365569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d09b73-8f6b-4550-a565-3620b37b41e1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:47.400128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:47.407243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:47.407243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:47.407243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:47.407243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:47.412805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 888/1780] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:47 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:47.417805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:47.419151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:47.487462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 893/1781] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:47.488477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:47.532411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfe0a8-3f6c-462f-a4e0-5c2dbf81a728 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:47.711311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a22c0-52d9-40e4-94fc-a9f38adcbe9a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:47.728279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:47.729010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:47.729514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:47.730176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:47.732747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:47.737843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:47.771942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:47.774748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:47.776288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:47.776657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] PATH_INFO: `/v3/projects/164e82481ed44ffeab20ffabb7e871ca/users/bee74a6207154c9aa7fa5c3dd0c7233d/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:47.790711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 889/1782] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:47 2022] POST /identity/v3/users => generated 296 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:47.795487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:47.835370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164e82481ed44ffeab20ffabb7e871ca, user_id=bee74a6207154c9aa7fa5c3dd0c7233d, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:47.849431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:47.867866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf3c5-88c7-420b-a77c-0fe169957064 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:47.889597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 894/1783] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:47 2022] PUT /identity/v3/projects/164e82481ed44ffeab20ffabb7e871ca/users/bee74a6207154c9aa7fa5c3dd0c7233d/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:47.891826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:48.023501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6127-7429-4c0e-b906-8cd928ae76d2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:48.030256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0993-e90c-4152-8138-7d5c1ce1776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:48.031907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0993-e90c-4152-8138-7d5c1ce1776d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:48.031907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0993-e90c-4152-8138-7d5c1ce1776d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:48.031907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0993-e90c-4152-8138-7d5c1ce1776d admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:48.032762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0993-e90c-4152-8138-7d5c1ce1776d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:48.034577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0993-e90c-4152-8138-7d5c1ce1776d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:48.064068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 895/1784] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:48.072443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:48.074122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:48.075132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:48.140423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] MFA Rules not processed for user `9308f360df864174967889252718bc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:48.144000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:48.144594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:48.147405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:48.149319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:48.149750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:48.152059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:48.162726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:48.188210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:48.217752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 890/1785] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:30:48.238375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:48.284059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b56d-2ead-4e47-b01b-61e067d75af1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:48.292742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 896/1786] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 15 07:30:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:48.303352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:48.306001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:48.311157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:48.313170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:48.315779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:48.316406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] PATH_INFO: `/v3/projects/164e82481ed44ffeab20ffabb7e871ca/users/bee74a6207154c9aa7fa5c3dd0c7233d/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:48.322252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164e82481ed44ffeab20ffabb7e871ca, user_id=bee74a6207154c9aa7fa5c3dd0c7233d, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:48.330865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:48.348695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:48.361901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9846e1-73e3-45f6-8665-1a0c38a304a2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:48.375461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 891/1787] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:48 2022] PUT /identity/v3/projects/164e82481ed44ffeab20ffabb7e871ca/users/bee74a6207154c9aa7fa5c3dd0c7233d/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:48.378810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:48.520370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:48.521323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:48.521712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:48.522091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] PATH_INFO: `/v3/projects/195940d16a844e538b590199b957ff45` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:48.523502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195940d16a844e538b590199b957ff45)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:48.526311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:48.643326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06efb4-7b35-404f-8d5b-90d02b5bed35 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:48.658558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195940d16a844e538b590199b957ff45', 'request_id': 'req-56b485c6-ef31-4ccd-a310-c3e89dd9af66'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:48.687004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195940d16a844e538b590199b957ff45', 'request_id': 'req-56b485c6-ef31-4ccd-a310-c3e89dd9af66'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:48.730353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195940d16a844e538b590199b957ff45', 'request_id': 'req-56b485c6-ef31-4ccd-a310-c3e89dd9af66'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:48.788930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] The token cache is being invalidate because project 195940d16a844e538b590199b957ff45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:48.789635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:48.792059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:48.793994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 897/1788] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:48 2022] DELETE /identity/v3/projects/195940d16a844e538b590199b957ff45 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:48.799937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:48.801711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:48.869047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e1bf2-703f-4a89-8b1e-1b557bd31ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:48.871419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1bf2-703f-4a89-8b1e-1b557bd31ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:48.872379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1bf2-703f-4a89-8b1e-1b557bd31ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:48.873776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1bf2-703f-4a89-8b1e-1b557bd31ab1 admin admin] PATH_INFO: `/v3/projects/e27fbe33b8834f3d9030ce0a5bee7bcb/users/fea3edb2cf6045d8a239b207e03ae5b6/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:48.915623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e1bf2-703f-4a89-8b1e-1b557bd31ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27fbe33b8834f3d9030ce0a5bee7bcb, user_id=fea3edb2cf6045d8a239b207e03ae5b6, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:48.920908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e1bf2-703f-4a89-8b1e-1b557bd31ab1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:48.958999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 892/1789] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:48 2022] PUT /identity/v3/projects/e27fbe33b8834f3d9030ce0a5bee7bcb/users/fea3edb2cf6045d8a239b207e03ae5b6/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:48.965964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:48.969705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:48.972088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:49.064085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b485c6-ef31-4ccd-a310-c3e89dd9af66 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:49.112560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] MFA Rules not processed for user `bee74a6207154c9aa7fa5c3dd0c7233d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:49.117276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:49.128648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:49.321108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353804-fb09-4c86-8ee8-c7e9a0b99448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:49.321775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353804-fb09-4c86-8ee8-c7e9a0b99448 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:49.322057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353804-fb09-4c86-8ee8-c7e9a0b99448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:49.322330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353804-fb09-4c86-8ee8-c7e9a0b99448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:49.337441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-42353804-fb09-4c86-8ee8-c7e9a0b99448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:49.384173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353804-fb09-4c86-8ee8-c7e9a0b99448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:49.397793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353804-fb09-4c86-8ee8-c7e9a0b99448 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:49.423662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 898/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:49.424975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:49.425260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:49.425532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:49.434788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 893/1791] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:49.434788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:49.438054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:49.494725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:49.570322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:49.573335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:49.641297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9af024-5aca-49f1-9451-c5491b1c80ba None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:49.652200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0f6d3-5e38-49e7-a977-6f859da5f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:49.653949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0f6d3-5e38-49e7-a977-6f859da5f10e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:49.654664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0f6d3-5e38-49e7-a977-6f859da5f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:49.656045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0f6d3-5e38-49e7-a977-6f859da5f10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:49.657069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0f6d3-5e38-49e7-a977-6f859da5f10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:49.660086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0f6d3-5e38-49e7-a977-6f859da5f10e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:49.677885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 894/1792] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:49.680956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76dbf8-e532-45b8-a537-d95901acac2b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:49.681466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76dbf8-e532-45b8-a537-d95901acac2b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:49.681930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76dbf8-e532-45b8-a537-d95901acac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:49.713872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2a76dbf8-e532-45b8-a537-d95901acac2b None None] MFA Rules not processed for user `c0cb3d32205b485eb96d1de3f5e0749f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:49.716578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2a76dbf8-e532-45b8-a537-d95901acac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:49.773283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 899/1793] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:49.774427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:49.781759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:49.974698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 895/1794] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:49.974698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76dbf8-e532-45b8-a537-d95901acac2b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:50.013455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76dbf8-e532-45b8-a537-d95901acac2b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:50.024691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00057-fd2f-4998-9744-cfd9b075dd64 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:50.028170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd04ea-81d9-4d4a-9be1-da2d042bddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:50.029407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd04ea-81d9-4d4a-9be1-da2d042bddbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.029723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd04ea-81d9-4d4a-9be1-da2d042bddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.033339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd04ea-81d9-4d4a-9be1-da2d042bddbb admin admin] PATH_INFO: `/v3/projects/e27fbe33b8834f3d9030ce0a5bee7bcb/users/fea3edb2cf6045d8a239b207e03ae5b6/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.040361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1f11a-dada-45cd-a9c4-5d3917132d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:50.042730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd04ea-81d9-4d4a-9be1-da2d042bddbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27fbe33b8834f3d9030ce0a5bee7bcb, user_id=fea3edb2cf6045d8a239b207e03ae5b6, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:50.043089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f11a-dada-45cd-a9c4-5d3917132d16 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.044117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f11a-dada-45cd-a9c4-5d3917132d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.046456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f11a-dada-45cd-a9c4-5d3917132d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.053394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd04ea-81d9-4d4a-9be1-da2d042bddbb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:50.079862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1f11a-dada-45cd-a9c4-5d3917132d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:50.087125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1f11a-dada-45cd-a9c4-5d3917132d16 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:50.097063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 896/1795] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:49 2022] PUT /identity/v3/projects/e27fbe33b8834f3d9030ce0a5bee7bcb/users/fea3edb2cf6045d8a239b207e03ae5b6/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:50.097063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e41bb-e763-400d-baae-c23bd2c06191 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.097063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e41bb-e763-400d-baae-c23bd2c06191 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.097063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e41bb-e763-400d-baae-c23bd2c06191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.121267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 900/1796] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:50.125266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a2e3-e918-4bb1-97aa-633a58174760 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.126970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a2e3-e918-4bb1-97aa-633a58174760 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.127375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a2e3-e918-4bb1-97aa-633a58174760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.192066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6d3e41bb-e763-400d-baae-c23bd2c06191 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:50.193338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6d3e41bb-e763-400d-baae-c23bd2c06191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:50.215426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-97e7a2e3-e918-4bb1-97aa-633a58174760 None None] MFA Rules not processed for user `fea3edb2cf6045d8a239b207e03ae5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:50.219985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-97e7a2e3-e918-4bb1-97aa-633a58174760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:50.417661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:50.458442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 897/1797] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:50.461693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e41bb-e763-400d-baae-c23bd2c06191 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:50.498552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 901/1798] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:50.504713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e41bb-e763-400d-baae-c23bd2c06191 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:50.514141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:50.516170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.516549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.516834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.518978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:50.519295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:50.523786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:50.554468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 898/1799] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:50.559154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a2e3-e918-4bb1-97aa-633a58174760 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:50.573865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a2e3-e918-4bb1-97aa-633a58174760 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:50.583367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:50.584012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.587283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.587582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.588341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:50.592086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:50.660450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 902/1800] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:50 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:50.664733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:50.678250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65f54-3990-4b0c-990e-53bd36bdce68 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:50.820386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:50.895180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:50.896923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.897204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.897484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.900675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:50.902914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:50.950697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 899/1801] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:50 2022] POST /identity/v3/users => generated 282 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:50.953410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:50.966584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e671-33e8-4965-b4cd-01bd4bf0f736 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:50.992710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:50.994774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:50.995092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:50.995374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:50.996082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:51.001204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:51.046203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 903/1802] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:51.048156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:51.061826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860397a-3f63-417c-849e-9aa45f5f8423 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:51.076437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d485c-22fc-42f5-a1aa-be211170a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:51.077126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d485c-22fc-42f5-a1aa-be211170a54f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:51.077406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d485c-22fc-42f5-a1aa-be211170a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:51.077678 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d485c-22fc-42f5-a1aa-be211170a54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:51.078355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d485c-22fc-42f5-a1aa-be211170a54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:51.080321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d485c-22fc-42f5-a1aa-be211170a54f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:51.116599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 900/1803] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:51.127884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:51.139606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f25f7-1dcf-4345-9f63-975abb954257 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:51.145659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fab51e-fa23-4764-a68f-e12c7eb20d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:51.146474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab51e-fa23-4764-a68f-e12c7eb20d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:51.146749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab51e-fa23-4764-a68f-e12c7eb20d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:51.147108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab51e-fa23-4764-a68f-e12c7eb20d95 admin admin] PATH_INFO: `/v3/projects/dc24c1b9a4ad45f38b5859ba99f5c678/users/e21144f2e0184f86b8176ddcf1c79435/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:51.195884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fab51e-fa23-4764-a68f-e12c7eb20d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc24c1b9a4ad45f38b5859ba99f5c678, user_id=e21144f2e0184f86b8176ddcf1c79435, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:51.198956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fab51e-fa23-4764-a68f-e12c7eb20d95 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:51.234568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 904/1804] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:51 2022] PUT /identity/v3/projects/dc24c1b9a4ad45f38b5859ba99f5c678/users/e21144f2e0184f86b8176ddcf1c79435/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:51.248784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42981c-732f-4fa4-a9ec-78ad050ff229 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:51.249051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42981c-732f-4fa4-a9ec-78ad050ff229 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:51.249485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42981c-732f-4fa4-a9ec-78ad050ff229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:51.302475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe0a2-ea77-48cc-970e-fb85b4b4ad0c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:51.302851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe0a2-ea77-48cc-970e-fb85b4b4ad0c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:51.303232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe0a2-ea77-48cc-970e-fb85b4b4ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:51.354426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8b42981c-732f-4fa4-a9ec-78ad050ff229 None None] MFA Rules not processed for user `e21144f2e0184f86b8176ddcf1c79435`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:51.357184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8b42981c-732f-4fa4-a9ec-78ad050ff229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:51.372303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e2dfe0a2-ea77-48cc-970e-fb85b4b4ad0c None None] MFA Rules not processed for user `0e421a45c825416fa5bf4aec29ed0c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:51.377185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e2dfe0a2-ea77-48cc-970e-fb85b4b4ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:51.706236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 901/1805] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:51.716974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42981c-732f-4fa4-a9ec-78ad050ff229 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:51.763916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 905/1806] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:30:51.921722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42981c-732f-4fa4-a9ec-78ad050ff229 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:51.937852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:51.938498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:51.938782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:51.939289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:51.940131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:51.951091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:51.984966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfe0a2-ea77-48cc-970e-fb85b4b4ad0c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:52.021277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 902/1807] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:51 2022] POST /identity/v3/projects => generated 365 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:52.029156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:52.120247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfe0a2-ea77-48cc-970e-fb85b4b4ad0c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:52.194978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:52.300230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:52.310751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:52.311862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:52.312150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:52.317016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:52.343191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:52.347587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bed155-db26-4756-a9ca-3671937e73bc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:52.388056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:52.389692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:52.389976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:52.390270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:52.390944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:52.392897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:52.513634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 903/1808] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:52 2022] POST /identity/v3/users => generated 289 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:30:52.522527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:52.567484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7039279-b096-4136-a062-309b593389d5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:52.588320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:52.589785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:52.590660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:52.591302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:52.592881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:52.593365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:52.595790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:52.608750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:52.636219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 906/1809] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:30:52.657007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 904/1810] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:52.662417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:52.694649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4de85c-dc53-42dc-b28e-85248807d3ae service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:52.717731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:52.718884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:52.719358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:52.719834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] PATH_INFO: `/v3/projects/0b1b6ae95bcf4aec8426f1598b2f73cb/users/41e81afcc8884893b38a74eaf4b8e6bf/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:52.777360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1b6ae95bcf4aec8426f1598b2f73cb, user_id=41e81afcc8884893b38a74eaf4b8e6bf, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:52.786175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:52.832627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 907/1811] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:52 2022] PUT /identity/v3/projects/0b1b6ae95bcf4aec8426f1598b2f73cb/users/41e81afcc8884893b38a74eaf4b8e6bf/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:52.836596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:52.853064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6314ae-c5f3-4cdf-ae0f-5d6f2f42b316 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:53.070396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3c936-4105-4433-96dc-3eab19f636e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:53.070656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3c936-4105-4433-96dc-3eab19f636e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:53.070932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3c936-4105-4433-96dc-3eab19f636e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:53.072672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3c936-4105-4433-96dc-3eab19f636e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:53.072672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3c936-4105-4433-96dc-3eab19f636e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:53.086858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3c936-4105-4433-96dc-3eab19f636e7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:53.130464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:53.131116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 905/1812] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:30:53.163039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cc20d-6a81-4dd4-86b7-6a44088182c0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:53.176447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:53.177219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:53.179133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:53.181612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] PATH_INFO: `/v3/projects/0b1b6ae95bcf4aec8426f1598b2f73cb/users/41e81afcc8884893b38a74eaf4b8e6bf/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:53.186621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1b6ae95bcf4aec8426f1598b2f73cb, user_id=41e81afcc8884893b38a74eaf4b8e6bf, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:53.194379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:53.212518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 908/1813] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:53 2022] PUT /identity/v3/projects/0b1b6ae95bcf4aec8426f1598b2f73cb/users/41e81afcc8884893b38a74eaf4b8e6bf/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:53.224624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f30c-db43-46e2-9133-3c4885eed914 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:53.224624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f30c-db43-46e2-9133-3c4885eed914 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:53.224926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f30c-db43-46e2-9133-3c4885eed914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:53.324673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec25f30c-db43-46e2-9133-3c4885eed914 None None] MFA Rules not processed for user `41e81afcc8884893b38a74eaf4b8e6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:53.326028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec25f30c-db43-46e2-9133-3c4885eed914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:53.652372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 906/1814] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:53.673735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:53.855229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9d0b-760a-4def-97a6-b471879019a7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:53.868892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977e778-5fcd-4ad2-b5aa-9c7269c093da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:53.869851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977e778-5fcd-4ad2-b5aa-9c7269c093da service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:53.870273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977e778-5fcd-4ad2-b5aa-9c7269c093da service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:53.870869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977e778-5fcd-4ad2-b5aa-9c7269c093da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:53.889260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977e778-5fcd-4ad2-b5aa-9c7269c093da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:53.892623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977e778-5fcd-4ad2-b5aa-9c7269c093da service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:53.918917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 909/1815] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:54.098941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25f30c-db43-46e2-9133-3c4885eed914 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:54.121580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25f30c-db43-46e2-9133-3c4885eed914 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:54.129887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:54.130544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:54.130817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:54.131452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:54.215622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:54.303732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:54.305066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:54.349447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 907/1816] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:54.818849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b723-260c-4e49-b029-7f95bcac12f8 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:54.819789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b723-260c-4e49-b029-7f95bcac12f8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:54.820090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b723-260c-4e49-b029-7f95bcac12f8 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:54.822673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 910/1817] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:30:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:54.864621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:54.866626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511db6b-521f-4dcf-8c73-c15e666eecff None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:54.867398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511db6b-521f-4dcf-8c73-c15e666eecff None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:54.868263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:54.868824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511db6b-521f-4dcf-8c73-c15e666eecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:54.947679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0511db6b-521f-4dcf-8c73-c15e666eecff None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:54.948942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0511db6b-521f-4dcf-8c73-c15e666eecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:55.130529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 911/1818] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:30:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:55.138356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e33f-7b6a-4d76-8df2-695ac09fe6e3 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:55.180065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:55.181070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:55.181731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:55.181731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] PATH_INFO: `/v3/users/ee8c5b28d91c4c7a9a92ddb14439a1ea` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:55.186372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8c5b28d91c4c7a9a92ddb14439a1ea)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:55.188434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:55.336022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8c5b28d91c4c7a9a92ddb14439a1ea'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:55.355802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8c5b28d91c4c7a9a92ddb14439a1ea'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:55.377600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8c5b28d91c4c7a9a92ddb14439a1ea'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:55.380516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8c5b28d91c4c7a9a92ddb14439a1ea'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:55.381335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8c5b28d91c4c7a9a92ddb14439a1ea'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:55.403214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 908/1819] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:54 2022] DELETE /identity/v3/users/ee8c5b28d91c4c7a9a92ddb14439a1ea => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:55.405794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc0a4-e721-41f4-b729-91c8a1cc6f21 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:55.406489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc0a4-e721-41f4-b729-91c8a1cc6f21 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:55.406889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc0a4-e721-41f4-b729-91c8a1cc6f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:55.420308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:55.439071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b6abc0a4-e721-41f4-b729-91c8a1cc6f21 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:55.442090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b6abc0a4-e721-41f4-b729-91c8a1cc6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:55.642994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 912/1820] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:30:55.685909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:55.690696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:55.847781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:55.883612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f70ca-f8dd-4023-9075-08138a35a8fd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:55.895622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccad44-4728-41e6-bc6d-a99298e318c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:55.896308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad44-4728-41e6-bc6d-a99298e318c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:55.896616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad44-4728-41e6-bc6d-a99298e318c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:55.896891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad44-4728-41e6-bc6d-a99298e318c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:55.914054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccad44-4728-41e6-bc6d-a99298e318c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:55.916204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccad44-4728-41e6-bc6d-a99298e318c1 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:55.928951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 909/1821] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:55.952845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28499-f74d-46d7-81a4-2e40f61a54d4 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:55.953357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28499-f74d-46d7-81a4-2e40f61a54d4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:55.953649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28499-f74d-46d7-81a4-2e40f61a54d4 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:55.954983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 913/1822] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:30:56.001335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:56.001645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:56.006785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:56.057100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:56.058614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:56.299865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 910/1823] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:30:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:56.386646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28499-f74d-46d7-81a4-2e40f61a54d4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:56.388467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a4b28499-f74d-46d7-81a4-2e40f61a54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:56.447907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28499-f74d-46d7-81a4-2e40f61a54d4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:56.473003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:56.478997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:56.481524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:56.483395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:56.490148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:56.544938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:56.554038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:56.600400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 914/1824] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:56.793062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:56.794844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:56.829366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106f813-2d42-4355-9fb4-4a9ae9788591 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:56.855553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:56.856410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:56.861153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:56.861694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:56.895568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:56.901375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:56.958751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 911/1825] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:57.766936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:57.768779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:57.822261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013fa5e-49a4-4a95-bdbf-0521e43e7cf2 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:57.845551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:57.846219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:57.846492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:57.846761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] PATH_INFO: `/v3/projects/6e2131929a4a4f37aff462700cbce7b0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:57.864094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2131929a4a4f37aff462700cbce7b0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:57.866681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:57.967050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2131929a4a4f37aff462700cbce7b0', 'request_id': 'req-5b4406a4-7462-43da-ab24-951994643bbc'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:57.967941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2131929a4a4f37aff462700cbce7b0', 'request_id': 'req-5b4406a4-7462-43da-ab24-951994643bbc'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:57.976570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2131929a4a4f37aff462700cbce7b0', 'request_id': 'req-5b4406a4-7462-43da-ab24-951994643bbc'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:57.990741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] The token cache is being invalidate because project 6e2131929a4a4f37aff462700cbce7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:57.991099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:57.992078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:57.996756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 915/1826] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:57 2022] DELETE /identity/v3/projects/6e2131929a4a4f37aff462700cbce7b0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:57.998168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:58.009022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d556c-b9aa-4749-9e60-c420578e518a service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:58.077438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:58.078092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:58.078430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:58.078761 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] PATH_INFO: `/v3/users/5579fd5894aa426b9e7c435cef077692` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:58.082095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5579fd5894aa426b9e7c435cef077692)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:58.084559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:58.136168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5579fd5894aa426b9e7c435cef077692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.144112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5579fd5894aa426b9e7c435cef077692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.151980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:58.157276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5579fd5894aa426b9e7c435cef077692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.158118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5579fd5894aa426b9e7c435cef077692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.158852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5579fd5894aa426b9e7c435cef077692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.182173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 912/1827] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:30:57 2022] DELETE /identity/v3/users/5579fd5894aa426b9e7c435cef077692 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:58.530456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:58.533105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:58.613339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4406a4-7462-43da-ab24-951994643bbc admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:58.613944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:58.615594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:58.684830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:58.715217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474747-e44d-4242-b6b1-58c2ea80eed1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:58.717232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacb640-d95e-43ad-90f3-3d5c939cd273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:58.717928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacb640-d95e-43ad-90f3-3d5c939cd273 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:58.718270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacb640-d95e-43ad-90f3-3d5c939cd273 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:58.718552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacb640-d95e-43ad-90f3-3d5c939cd273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:58.720410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dfacb640-d95e-43ad-90f3-3d5c939cd273 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:58.720543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:58.721318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:58.721599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:58.721871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] PATH_INFO: `/v3/projects/8e592a1087304b8f94990aeb9e89b7c1` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:58.723132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e592a1087304b8f94990aeb9e89b7c1)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:58.725389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:58.793036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e592a1087304b8f94990aeb9e89b7c1', 'request_id': 'req-880ff1a0-aa76-495e-b25c-576e82fdc076'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.815042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e592a1087304b8f94990aeb9e89b7c1', 'request_id': 'req-880ff1a0-aa76-495e-b25c-576e82fdc076'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.819288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacb640-d95e-43ad-90f3-3d5c939cd273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:58.821438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacb640-d95e-43ad-90f3-3d5c939cd273 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:58.832386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 916/1828] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:30:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:30:58.837238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e592a1087304b8f94990aeb9e89b7c1', 'request_id': 'req-880ff1a0-aa76-495e-b25c-576e82fdc076'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.852453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] The token cache is being invalidate because project 8e592a1087304b8f94990aeb9e89b7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:30:58.852831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.854677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-880ff1a0-aa76-495e-b25c-576e82fdc076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:30:58.856712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 913/1829] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:30:58 2022] DELETE /identity/v3/projects/8e592a1087304b8f94990aeb9e89b7c1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:58.861779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165efe79-d281-4ba1-8bf3-f417561962be None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:58.862064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165efe79-d281-4ba1-8bf3-f417561962be None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:58.862340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165efe79-d281-4ba1-8bf3-f417561962be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:58.895040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-165efe79-d281-4ba1-8bf3-f417561962be None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:58.896598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-165efe79-d281-4ba1-8bf3-f417561962be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:59.061593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 917/1830] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:59.069465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bc51-b091-45df-ada7-a799edac37e6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.070566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bc51-b091-45df-ada7-a799edac37e6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.071169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bc51-b091-45df-ada7-a799edac37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.108719 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0365bc51-b091-45df-ada7-a799edac37e6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:59.111282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0365bc51-b091-45df-ada7-a799edac37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:59.127628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 914/1831] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:59.129054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165efe79-d281-4ba1-8bf3-f417561962be None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.142655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165efe79-d281-4ba1-8bf3-f417561962be None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:59.156376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:59.157064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.157897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.158186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.158881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:30:59.159196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:59.161499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:59.187405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 918/1832] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:30:59.191935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365bc51-b091-45df-ada7-a799edac37e6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.204166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365bc51-b091-45df-ada7-a799edac37e6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:59.209847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:59.210526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.210803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.211173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.211834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:59.214057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:59.251794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 915/1833] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:59 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:30:59.259197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.280267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffcb07-03da-4f8e-bd8f-c0e790d9dfae admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:59.356850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:59.357477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.357753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.358024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.358666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:59.361650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:59.402461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 919/1834] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:59 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:30:59.403859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.434849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec4da-466e-4a4a-85f2-5a5db10d510c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:59.434849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:59.434849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.435669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.436124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.437640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:59.440860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:59.456997 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 916/1835] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:30:59.460899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.468655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:59.491427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d384d-04e4-432c-8ee4-033ca8f7c3a0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:59.507197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a80ac-68fd-49e6-ab45-32e3631500c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:59.508086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a80ac-68fd-49e6-ab45-32e3631500c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.508535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a80ac-68fd-49e6-ab45-32e3631500c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.508936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a80ac-68fd-49e6-ab45-32e3631500c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.509732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a80ac-68fd-49e6-ab45-32e3631500c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:59.511632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a80ac-68fd-49e6-ab45-32e3631500c1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:59.552894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 920/1836] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:30:59.554032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.581479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3ae0-777e-4689-a17e-6e7d9b2730df admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:59.603133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:59.603786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.604070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.604426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] PATH_INFO: `/v3/projects/a341200edbcf4ef1856da562be5a96f3/users/bda5832dc2f94eb0a5cd17fe8a03ffb2/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.655749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a341200edbcf4ef1856da562be5a96f3, user_id=bda5832dc2f94eb0a5cd17fe8a03ffb2, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:59.658657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:59.685606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 917/1837] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:30:59 2022] PUT /identity/v3/projects/a341200edbcf4ef1856da562be5a96f3/users/bda5832dc2f94eb0a5cd17fe8a03ffb2/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:30:59.698635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8875a-adee-4900-a112-26831210ce62 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.698635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8875a-adee-4900-a112-26831210ce62 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.698635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8875a-adee-4900-a112-26831210ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.750959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-71e8875a-adee-4900-a112-26831210ce62 None None] MFA Rules not processed for user `bda5832dc2f94eb0a5cd17fe8a03ffb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:30:59.752477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-71e8875a-adee-4900-a112-26831210ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:30:59.839793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 921/1838] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:30:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:30:59.844424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.856160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:30:59.927814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9a77b-1c94-4821-9a28-fc18b50353c8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:30:59.933919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:30:59.934539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:30:59.934849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:30:59.935117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:30:59.935765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:30:59.937679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:30:59.977264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 918/1839] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:30:59 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:30:59.981784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8875a-adee-4900-a112-26831210ce62 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:30:59.992717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8875a-adee-4900-a112-26831210ce62 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:00.053579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:00.054284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:00.054487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:00.054776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:00.055531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:00.057540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:00.097809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 922/1840] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:30:59 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:00.105003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:00.119718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0656f-cca2-4116-b627-5bbf3288ea8c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:00.125273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:00.128421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:00.128421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:00.128421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:00.128724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:00.130397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:00.143632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 919/1841] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:00.147428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:00.160272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a6ba-53eb-48ff-9680-d4136e5a5573 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:00.165581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:00.166815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:00.167193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:00.167537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] PATH_INFO: `/v3/projects/8c7d5fac23fa4cc295a344c347ebb4ec/users/2cf64065c9e448ca9d7bcd26794e9594/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:00.189246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7d5fac23fa4cc295a344c347ebb4ec, user_id=2cf64065c9e448ca9d7bcd26794e9594, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:00.192300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:00.211125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 923/1842] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:00 2022] PUT /identity/v3/projects/8c7d5fac23fa4cc295a344c347ebb4ec/users/2cf64065c9e448ca9d7bcd26794e9594/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:00.212188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:00.223045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277467d-a161-4f9a-89e6-8070a1b6c963 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:00.285888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd8dc0-f9f6-43c6-8e27-17d0faed0a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:00.286574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8dc0-f9f6-43c6-8e27-17d0faed0a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:00.286885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8dc0-f9f6-43c6-8e27-17d0faed0a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:00.287163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8dc0-f9f6-43c6-8e27-17d0faed0a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:00.287815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8dc0-f9f6-43c6-8e27-17d0faed0a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:00.289488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8dc0-f9f6-43c6-8e27-17d0faed0a70 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:00.302389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 920/1843] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:00.306583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:00.318471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bcb98-5359-40c0-a3e1-aa2e3d46f2dc admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:00.325037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:00.325814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:00.326390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:00.326390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] PATH_INFO: `/v3/projects/8c7d5fac23fa4cc295a344c347ebb4ec/users/2cf64065c9e448ca9d7bcd26794e9594/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:00.328719 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7d5fac23fa4cc295a344c347ebb4ec, user_id=2cf64065c9e448ca9d7bcd26794e9594, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:00.331700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:00.353271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 924/1844] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:00 2022] PUT /identity/v3/projects/8c7d5fac23fa4cc295a344c347ebb4ec/users/2cf64065c9e448ca9d7bcd26794e9594/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:00.369849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f97a-32b1-4beb-8390-0b8c18a940e0 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:00.370067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f97a-32b1-4beb-8390-0b8c18a940e0 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:00.370358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f97a-32b1-4beb-8390-0b8c18a940e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:00.421754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e176f97a-32b1-4beb-8390-0b8c18a940e0 None None] MFA Rules not processed for user `2cf64065c9e448ca9d7bcd26794e9594`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:00.423001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e176f97a-32b1-4beb-8390-0b8c18a940e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:00.505331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 921/1845] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:00.518047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:00.519883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:00.555087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:00.577509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24be36-35dd-4015-b196-bce847c4bdfa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:00.581117 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f790d82-f4cd-4898-aeac-7919268be954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:00.581724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790d82-f4cd-4898-aeac-7919268be954 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:00.582002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790d82-f4cd-4898-aeac-7919268be954 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:00.582274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790d82-f4cd-4898-aeac-7919268be954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:00.591569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f790d82-f4cd-4898-aeac-7919268be954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:00.593045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f790d82-f4cd-4898-aeac-7919268be954 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:00.602476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 925/1846] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:01.113795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f97a-32b1-4beb-8390-0b8c18a940e0 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:01.119539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:01.181449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f97a-32b1-4beb-8390-0b8c18a940e0 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:01.186901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:01.187546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:01.187906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:01.188242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] PATH_INFO: `/v3/users/bda5832dc2f94eb0a5cd17fe8a03ffb2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:01.189311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda5832dc2f94eb0a5cd17fe8a03ffb2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:01.191396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:01.247815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda5832dc2f94eb0a5cd17fe8a03ffb2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.256436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda5832dc2f94eb0a5cd17fe8a03ffb2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.268601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda5832dc2f94eb0a5cd17fe8a03ffb2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.269261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda5832dc2f94eb0a5cd17fe8a03ffb2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.269932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda5832dc2f94eb0a5cd17fe8a03ffb2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.282723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 922/1847] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:01 2022] DELETE /identity/v3/users/bda5832dc2f94eb0a5cd17fe8a03ffb2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:01.287201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:01.287663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:01.287781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:01.306757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:01.308001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:01.379479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 926/1848] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:01.390277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:01.392764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:01.491922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e1532-56dc-4d7f-a98a-7c97c2daaba9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:01.500825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:01.501895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:01.502440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:01.502926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:01.511695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:01.513155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:01.514757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:01.517244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:01.536732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 923/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:01.537900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:01.539523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:01.553994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3dc10-f736-4c87-8150-2cbfe1b93fee service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:01.559804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:01.560738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:01.561513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:01.562002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] PATH_INFO: `/v3/users/2c70487d64cb447799179e276b70c13b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:01.563463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c70487d64cb447799179e276b70c13b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:01.565595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:01.603028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44f4d9-d95a-48e7-8ad3-e03df59f27d2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:01.604485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:01.614009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb0945-7c06-41f2-94f6-ab4bc86f88ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:01.615055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0945-7c06-41f2-94f6-ab4bc86f88ec service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:01.633628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0945-7c06-41f2-94f6-ab4bc86f88ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:01.633869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0945-7c06-41f2-94f6-ab4bc86f88ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:01.638386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e4fb0945-7c06-41f2-94f6-ab4bc86f88ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:01.682598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c70487d64cb447799179e276b70c13b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.700912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c70487d64cb447799179e276b70c13b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.729536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c70487d64cb447799179e276b70c13b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.730326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c70487d64cb447799179e276b70c13b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.731031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c70487d64cb447799179e276b70c13b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:01.743709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb0945-7c06-41f2-94f6-ab4bc86f88ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:01.756530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb0945-7c06-41f2-94f6-ab4bc86f88ec service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:01.782872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 927/1850] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:01.787572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 924/1851] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:01 2022] DELETE /identity/v3/users/2c70487d64cb447799179e276b70c13b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:01.792579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:01.793035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:01.793763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:01.880587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:01.883657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:01.920502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:01.970525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 928/1852] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:01.990702 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:01.992517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:02.076768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973533-1a6b-4f04-8501-03e1b86b6f7d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:02.082615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:02.083405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:02.083686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:02.083959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:02.100354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:02.102943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:02.119348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 925/1853] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:02.385520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:02.387749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:02.417049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:02.418659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:02.431622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4725c-1e5c-4fb6-9d59-dd714bb28685 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:02.476341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:02.477081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:02.477359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:02.477632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] PATH_INFO: `/v3/users/e21144f2e0184f86b8176ddcf1c79435` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:02.479107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21144f2e0184f86b8176ddcf1c79435)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:02.481655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:02.628611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21144f2e0184f86b8176ddcf1c79435'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:02.645913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21144f2e0184f86b8176ddcf1c79435'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:02.646810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21144f2e0184f86b8176ddcf1c79435'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:02.647603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21144f2e0184f86b8176ddcf1c79435'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:02.655886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d69f831d-9bcd-42da-b371-0920fd41053c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21144f2e0184f86b8176ddcf1c79435'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:02.664227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5a14-8e7d-4432-9954-0bd13ecc87c2 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:02.677403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 929/1854] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:02 2022] DELETE /identity/v3/users/e21144f2e0184f86b8176ddcf1c79435 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:02.681681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:02.682099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea3edb2cf6045d8a239b207e03ae5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27fbe33b8834f3d9030ce0a5bee7bcb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:02.682235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:02.682632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:02.682732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:02.683040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:02.683333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:02.684080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:02.684382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:02.686085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:02.701950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 926/1855] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:31:02.707134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:02.709110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:02.711207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:02.712441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:02.729849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f08b-ded0-47ea-8e9e-f14d3234b5a5 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:02.804614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 930/1856] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:02.804920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:02.837981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:02.840865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:02.852914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea3edb2cf6045d8a239b207e03ae5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27fbe33b8834f3d9030ce0a5bee7bcb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:02.853604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:02.853971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:02.855028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:02.856427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:02.858893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:02.899547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:02.903798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 927/1857] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:02 2022] POST /identity/v3/projects => generated 354 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:02.909664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:02.939047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c20d-35b6-4435-b307-c91ded810fc6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:03.027207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00962013-3aaf-4ed3-aab3-e5c8caf29f5a tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:03.032324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea3edb2cf6045d8a239b207e03ae5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27fbe33b8834f3d9030ce0a5bee7bcb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:03.033150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:03.033455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:03.033781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:03.034507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:03.034854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:03.036732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:03.040905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:03.041916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:03.042392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:03.043058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:03.055675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 928/1858] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:03.071045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:03.073096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:03.158786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:03.160791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:03.178191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 931/1859] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:03.179614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:03.194652 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1574c-3e07-4f1d-832a-2964fcf45822 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:03.200259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea3edb2cf6045d8a239b207e03ae5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e27fbe33b8834f3d9030ce0a5bee7bcb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:03.201617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:03.202477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:03.202891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] PATH_INFO: `/v3/projects/476aea0b2c0e4e918bf8d4136eb0c76a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:03.205696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorizing `identity:delete_project(project_id=476aea0b2c0e4e918bf8d4136eb0c76a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:03.208692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:03.230499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0823a71-ecf6-4bbc-b5b4-b196eee4716c tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:03.237230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:03.239005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:03.239449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:03.239733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] PATH_INFO: `/v3/projects/a341200edbcf4ef1856da562be5a96f3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:03.240957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a341200edbcf4ef1856da562be5a96f3)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:03.243735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:03.277367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476aea0b2c0e4e918bf8d4136eb0c76a', 'request_id': 'req-4d965e74-d566-4d78-86ac-05b1e5be2952'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.284390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476aea0b2c0e4e918bf8d4136eb0c76a', 'request_id': 'req-4d965e74-d566-4d78-86ac-05b1e5be2952'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.296912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476aea0b2c0e4e918bf8d4136eb0c76a', 'request_id': 'req-4d965e74-d566-4d78-86ac-05b1e5be2952'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.313430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] The token cache is being invalidate because project 476aea0b2c0e4e918bf8d4136eb0c76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:03.313866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.314753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.320448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 932/1860] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:03 2022] DELETE /identity/v3/projects/476aea0b2c0e4e918bf8d4136eb0c76a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:03.332347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a341200edbcf4ef1856da562be5a96f3', 'request_id': 'req-26cb1322-9bb9-4743-8c2f-89f47cab64a2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.350657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a341200edbcf4ef1856da562be5a96f3', 'request_id': 'req-26cb1322-9bb9-4743-8c2f-89f47cab64a2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.352956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:03.366555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a341200edbcf4ef1856da562be5a96f3', 'request_id': 'req-26cb1322-9bb9-4743-8c2f-89f47cab64a2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.413762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] The token cache is being invalidate because project a341200edbcf4ef1856da562be5a96f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:03.414112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.417571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.424058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 929/1861] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:03 2022] DELETE /identity/v3/projects/a341200edbcf4ef1856da562be5a96f3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:03.427511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:03.429666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:03.493260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:03.564240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d965e74-d566-4d78-86ac-05b1e5be2952 tempest-VolumeQuotaClassesTest-933146072 tempest-VolumeQuotaClassesTest-933146072-project-admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:03.644616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:03.646312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:03.677438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:03.678431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:03.679020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:03.679467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] PATH_INFO: `/v3/users/2cf64065c9e448ca9d7bcd26794e9594` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:03.682847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf64065c9e448ca9d7bcd26794e9594)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:03.685065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:03.785134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf64065c9e448ca9d7bcd26794e9594'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.805727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb1322-9bb9-4743-8c2f-89f47cab64a2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:03.807540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf64065c9e448ca9d7bcd26794e9594'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.808206 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf64065c9e448ca9d7bcd26794e9594'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.808963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf64065c9e448ca9d7bcd26794e9594'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.821566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28904a48-31c7-4497-a9f9-0ac67685f446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf64065c9e448ca9d7bcd26794e9594'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.828427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:03.830986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:03.831305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:03.831539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] PATH_INFO: `/v3/users/ec617642090045cbb858d698e2a7010a` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:03.837510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec617642090045cbb858d698e2a7010a)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:03.841240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:03.852777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 933/1862] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:03 2022] DELETE /identity/v3/users/2cf64065c9e448ca9d7bcd26794e9594 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:03.903313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec617642090045cbb858d698e2a7010a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.916885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec617642090045cbb858d698e2a7010a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.932293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec617642090045cbb858d698e2a7010a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.933242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec617642090045cbb858d698e2a7010a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.934098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec617642090045cbb858d698e2a7010a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:03.952721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 930/1863] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:03 2022] DELETE /identity/v3/users/ec617642090045cbb858d698e2a7010a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:03.953940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d2bbd-bee0-49c4-aad1-d245d58ad6a6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:03.954226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d2bbd-bee0-49c4-aad1-d245d58ad6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:03.954500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d2bbd-bee0-49c4-aad1-d245d58ad6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:03.978242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-096d2bbd-bee0-49c4-aad1-d245d58ad6a6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:03.979263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-096d2bbd-bee0-49c4-aad1-d245d58ad6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:04.064740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:04.081823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 934/1864] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:04.143657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:04.145579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:04.176320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672456f-2f9d-446e-9898-acd5fe11ed39 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:04.195406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85473358-54c6-418f-8148-db046685e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:04.196199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85473358-54c6-418f-8148-db046685e75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:04.196542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85473358-54c6-418f-8148-db046685e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:04.196882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85473358-54c6-418f-8148-db046685e75f admin admin] PATH_INFO: `/v3/projects/99fb05eb9fa24f43b82ce076f9363ded` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:04.198394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85473358-54c6-418f-8148-db046685e75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fb05eb9fa24f43b82ce076f9363ded)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:04.201340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85473358-54c6-418f-8148-db046685e75f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:04.280791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fb05eb9fa24f43b82ce076f9363ded', 'request_id': 'req-85473358-54c6-418f-8148-db046685e75f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.295129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fb05eb9fa24f43b82ce076f9363ded', 'request_id': 'req-85473358-54c6-418f-8148-db046685e75f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.298850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:04.307089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fb05eb9fa24f43b82ce076f9363ded', 'request_id': 'req-85473358-54c6-418f-8148-db046685e75f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.337065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-85473358-54c6-418f-8148-db046685e75f admin admin] The token cache is being invalidate because project 99fb05eb9fa24f43b82ce076f9363ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:04.337430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.338231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.340267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 931/1865] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:04 2022] DELETE /identity/v3/projects/99fb05eb9fa24f43b82ce076f9363ded => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:04.344429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d2bbd-bee0-49c4-aad1-d245d58ad6a6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:04.357705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d2bbd-bee0-49c4-aad1-d245d58ad6a6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:04.417605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:04.418599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:04.474356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:04.474963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:04.475045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:04.475960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] PATH_INFO: `/v3/users/4112d0a3e5694fd29e4dd2db9f3a2519` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:04.477207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4112d0a3e5694fd29e4dd2db9f3a2519)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:04.479306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:04.531856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85473358-54c6-418f-8148-db046685e75f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:04.539647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:04.540526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:04.540908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:04.541408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] PATH_INFO: `/v3/projects/dc24c1b9a4ad45f38b5859ba99f5c678` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:04.543175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc24c1b9a4ad45f38b5859ba99f5c678)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:04.547436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:04.553394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4112d0a3e5694fd29e4dd2db9f3a2519'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.564483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4112d0a3e5694fd29e4dd2db9f3a2519'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.565228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4112d0a3e5694fd29e4dd2db9f3a2519'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.566035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4112d0a3e5694fd29e4dd2db9f3a2519'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.580898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4112d0a3e5694fd29e4dd2db9f3a2519'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.605449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 935/1866] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:04 2022] DELETE /identity/v3/users/4112d0a3e5694fd29e4dd2db9f3a2519 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:04.607089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:04.609007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:04.624345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc24c1b9a4ad45f38b5859ba99f5c678', 'request_id': 'req-b3422154-3a78-4d8b-881d-abd2bcf4563e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.640746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc24c1b9a4ad45f38b5859ba99f5c678', 'request_id': 'req-b3422154-3a78-4d8b-881d-abd2bcf4563e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.649798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc24c1b9a4ad45f38b5859ba99f5c678', 'request_id': 'req-b3422154-3a78-4d8b-881d-abd2bcf4563e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.664128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] The token cache is being invalidate because project dc24c1b9a4ad45f38b5859ba99f5c678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:04.664621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.665533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.667596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 932/1867] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:04 2022] DELETE /identity/v3/projects/dc24c1b9a4ad45f38b5859ba99f5c678 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:04.671804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:04.675369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:04.739753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f5f31-2f24-4fbd-bacf-06a7de578342 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:04.749392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:04.749695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:04.749966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:04.750245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:04.759108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:04.813297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:04.877882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422154-3a78-4d8b-881d-abd2bcf4563e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:04.886338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:04.888286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:04.891847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:04.892527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:04.892818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:04.893083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] PATH_INFO: `/v3/users/41e81afcc8884893b38a74eaf4b8e6bf` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:04.894534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e81afcc8884893b38a74eaf4b8e6bf)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:04.896565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:04.919033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 936/1868] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:04.930268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:04.974676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e81afcc8884893b38a74eaf4b8e6bf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:04.994291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e81afcc8884893b38a74eaf4b8e6bf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.018467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e81afcc8884893b38a74eaf4b8e6bf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.019408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e81afcc8884893b38a74eaf4b8e6bf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.020488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e81afcc8884893b38a74eaf4b8e6bf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.043939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 933/1869] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:04 2022] DELETE /identity/v3/users/41e81afcc8884893b38a74eaf4b8e6bf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:05.486293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:05.486293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:05.504968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379222f-e0d8-442d-b002-a31bc570df1f service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:05.623764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:05.624479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:05.624762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:05.626888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] PATH_INFO: `/v3/projects/8c7d5fac23fa4cc295a344c347ebb4ec` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:05.630080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7d5fac23fa4cc295a344c347ebb4ec)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:05.637698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:05.742644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7d5fac23fa4cc295a344c347ebb4ec', 'request_id': 'req-0c24530c-8369-4a23-bbeb-13df18e2bece'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.754385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7d5fac23fa4cc295a344c347ebb4ec', 'request_id': 'req-0c24530c-8369-4a23-bbeb-13df18e2bece'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.755045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:05.758177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:05.780291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7d5fac23fa4cc295a344c347ebb4ec', 'request_id': 'req-0c24530c-8369-4a23-bbeb-13df18e2bece'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.801196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2eaf3-9510-4d62-a456-765fa2b673ee admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:05.840714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] The token cache is being invalidate because project 8c7d5fac23fa4cc295a344c347ebb4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:05.840714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.852606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:05.857287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 937/1870] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:05 2022] DELETE /identity/v3/projects/8c7d5fac23fa4cc295a344c347ebb4ec => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:05.857777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:05.872929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:05.920582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:05.922232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:05.923052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:05.924409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] PATH_INFO: `/v3/projects/40696c0397d14f61aee176484fae050b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:05.927895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=40696c0397d14f61aee176484fae050b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:05.930729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:05.989096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:05.999745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24530c-8369-4a23-bbeb-13df18e2bece admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:06.020725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40696c0397d14f61aee176484fae050b', 'request_id': 'req-798bc090-e545-4c93-9e48-796eacc03bed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.032218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40696c0397d14f61aee176484fae050b', 'request_id': 'req-798bc090-e545-4c93-9e48-796eacc03bed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.043064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40696c0397d14f61aee176484fae050b', 'request_id': 'req-798bc090-e545-4c93-9e48-796eacc03bed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.069025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] The token cache is being invalidate because project 40696c0397d14f61aee176484fae050b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:06.070813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.071258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-798bc090-e545-4c93-9e48-796eacc03bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.076627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 934/1871] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:05 2022] DELETE /identity/v3/projects/40696c0397d14f61aee176484fae050b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:06.081717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde019b-41a2-440e-b82d-4722d661189b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.081933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde019b-41a2-440e-b82d-4722d661189b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.082332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde019b-41a2-440e-b82d-4722d661189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.091503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:06.092445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.093042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.093510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] PATH_INFO: `/v3/projects/0b1b6ae95bcf4aec8426f1598b2f73cb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.095153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1b6ae95bcf4aec8426f1598b2f73cb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:06.097621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:06.129966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-bcde019b-41a2-440e-b82d-4722d661189b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:06.149983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bcde019b-41a2-440e-b82d-4722d661189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.167191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1b6ae95bcf4aec8426f1598b2f73cb', 'request_id': 'req-6986d942-4b89-49d4-81b4-43dd6981a2ba'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.175226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:06.176016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1b6ae95bcf4aec8426f1598b2f73cb', 'request_id': 'req-6986d942-4b89-49d4-81b4-43dd6981a2ba'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.189569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1b6ae95bcf4aec8426f1598b2f73cb', 'request_id': 'req-6986d942-4b89-49d4-81b4-43dd6981a2ba'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.209724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] The token cache is being invalidate because project 0b1b6ae95bcf4aec8426f1598b2f73cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:06.210186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.211169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.217986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 938/1872] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:05 2022] DELETE /identity/v3/projects/0b1b6ae95bcf4aec8426f1598b2f73cb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:06.217986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:06.219141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.241957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 935/1873] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:06.243977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ff2bb-5b49-4f96-a839-481200932cb9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.244757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ff2bb-5b49-4f96-a839-481200932cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.245060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ff2bb-5b49-4f96-a839-481200932cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.278406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d01ff2bb-5b49-4f96-a839-481200932cb9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:06.280601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d01ff2bb-5b49-4f96-a839-481200932cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.300816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 936/1874] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:06.303443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.303728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.304003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.320697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986d942-4b89-49d4-81b4-43dd6981a2ba admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:06.335963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:06.337216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.338644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.338974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] PATH_INFO: `/v3/users/bee74a6207154c9aa7fa5c3dd0c7233d` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.342473 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee74a6207154c9aa7fa5c3dd0c7233d)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:06.346056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:06.356355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:06.359964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.375953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 937/1875] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:06.376688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:06.378737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.394247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443984aa-9f48-4d2b-8b54-343b91e65140 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:06.402849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:06.403897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.404127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.404446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] PATH_INFO: `/v3/projects/344ccf02248a43d8a14e0075918a673d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.408470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] RBAC: Authorizing `identity:delete_project(project_id=344ccf02248a43d8a14e0075918a673d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:06.414611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:06.469145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:06.488349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee74a6207154c9aa7fa5c3dd0c7233d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.508497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee74a6207154c9aa7fa5c3dd0c7233d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.509431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee74a6207154c9aa7fa5c3dd0c7233d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.510379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee74a6207154c9aa7fa5c3dd0c7233d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.520436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-037392b5-de75-498b-81d7-7a6ff1a262db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee74a6207154c9aa7fa5c3dd0c7233d'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.524389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344ccf02248a43d8a14e0075918a673d', 'request_id': 'req-a8e8b13e-c141-4a8e-9369-5d592526acac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.543534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344ccf02248a43d8a14e0075918a673d', 'request_id': 'req-a8e8b13e-c141-4a8e-9369-5d592526acac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.550791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344ccf02248a43d8a14e0075918a673d', 'request_id': 'req-a8e8b13e-c141-4a8e-9369-5d592526acac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.562659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 939/1876] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:06 2022] DELETE /identity/v3/users/bee74a6207154c9aa7fa5c3dd0c7233d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:06.564404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.564686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.564954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.574949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] The token cache is being invalidate because project 344ccf02248a43d8a14e0075918a673d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:06.575287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.577615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a8e8b13e-c141-4a8e-9369-5d592526acac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.581354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 938/1877] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:06 2022] DELETE /identity/v3/projects/344ccf02248a43d8a14e0075918a673d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:06.587990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652874a-5ca6-49f2-893d-c3940f10d317 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.588286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652874a-5ca6-49f2-893d-c3940f10d317 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.588493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652874a-5ca6-49f2-893d-c3940f10d317 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.590769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 939/1878] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:31:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:31:06.595077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652874a-5ca6-49f2-893d-c3940f10d317 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:06.601676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3652874a-5ca6-49f2-893d-c3940f10d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.620519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:06.620519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.743269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 940/1879] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:06.744515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652874a-5ca6-49f2-893d-c3940f10d317 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:06.744638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:06.745621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.755626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef77ee5-2a88-4ad6-b8b9-76127e41d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:06.756804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef77ee5-2a88-4ad6-b8b9-76127e41d537 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.756804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef77ee5-2a88-4ad6-b8b9-76127e41d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.757088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef77ee5-2a88-4ad6-b8b9-76127e41d537 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.757579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22920c-05fe-4918-a841-69b4adb82e1f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:06.758333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef77ee5-2a88-4ad6-b8b9-76127e41d537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:06.758757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef77ee5-2a88-4ad6-b8b9-76127e41d537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:06.761779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef77ee5-2a88-4ad6-b8b9-76127e41d537 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:06.771548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:06.772468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.772962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.773326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] PATH_INFO: `/v3/users/fea3edb2cf6045d8a239b207e03ae5b6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.775061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea3edb2cf6045d8a239b207e03ae5b6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:06.779107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:06.793323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 940/1880] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:06.794903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:06.795350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:06.795782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:06.842932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:06.844958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.883267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea3edb2cf6045d8a239b207e03ae5b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.894354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea3edb2cf6045d8a239b207e03ae5b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.895360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea3edb2cf6045d8a239b207e03ae5b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.896496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea3edb2cf6045d8a239b207e03ae5b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.901794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:06.907947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea3edb2cf6045d8a239b207e03ae5b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:06.933776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 941/1881] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:06 2022] DELETE /identity/v3/users/fea3edb2cf6045d8a239b207e03ae5b6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:06.933776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:06.935397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:06.991412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 941/1882] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:06.992525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:06.995244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:06.998414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:07.018646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe7c57-8f52-4e0a-a221-c88cc83954e4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.089538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36656e2-fe74-4347-b858-7e6216099f3e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.095305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.096278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.096278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.096515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.097028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:07.097326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.099134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.100477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.101394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.101940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.102398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.103269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.105756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.113155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 942/1883] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:07.117311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.119237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:07.151875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 942/1884] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:06 2022] POST /identity/v3/projects => generated 355 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:07.153053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.244491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e096fef-c73b-4243-a1ad-8580dc56c6f5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.251191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.252062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.252757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.253303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.254129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.256626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.262127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd497eb-3612-44a9-969d-6c8ca3576f9e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.296920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 943/1885] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:07 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:07.298195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.380319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:07.404336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.406806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.407252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.407400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.429943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.434387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.447098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 943/1886] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:07.448401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.461504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe132957-726a-4233-83f7-6880169d2c60 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.469518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f9b60-c697-43d4-99fd-c049ef04a4ea service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.477291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.478011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.478400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.479040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.480778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.484230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.485869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.486007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.486220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.486402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.487074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.489138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.518667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 944/1887] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:07 2022] POST /identity/v3/users => generated 278 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:07.522662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.527344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 944/1888] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:07 2022] POST /identity/v3/users => generated 293 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:07.528945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.535084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690821a2-109a-4f22-8cac-d02a5f974024 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.540682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.541607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.541989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.542382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.543186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.544912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.560258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 945/1889] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:07.560518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ac3c6-588a-40f9-92fa-71c322d1eee8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.561668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.567312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.567982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.568303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.568701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.569585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.571780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.575989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520844a-8490-4974-bea7-0bd7da9b2609 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.581964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.582791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.583200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.583577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.584335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.585027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 945/1890] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:07.586552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.590810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.604730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 946/1891] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:07.608531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7619b5-02a6-4675-ab4b-9d68cacc6fac admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.609773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.618190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.619023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.620107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.622189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.623051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.625102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.631064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c2d20-8e74-4a18-8a87-480cb0f4ae0f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.645610 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.646458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.646858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.647225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] PATH_INFO: `/v3/projects/9fc26a3fc2bb477d8f479faa7acc4669/users/e20f32b26dfb46a78ebd13869e427cd1/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.652059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 946/1892] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:07.655735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.661987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:07.678462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d953ca-9f3f-4328-b8c7-edbf0ea050da admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.685478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a210330-b2ab-4a5d-90c3-dcabaa5bcd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.686765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a210330-b2ab-4a5d-90c3-dcabaa5bcd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.686765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a210330-b2ab-4a5d-90c3-dcabaa5bcd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.687703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a210330-b2ab-4a5d-90c3-dcabaa5bcd24 admin admin] PATH_INFO: `/v3/projects/40e0d9c9fa234a679f27ede846d9c53e/users/71624d09c0cf4c5dbab27d15aba3cdd9/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.693270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc26a3fc2bb477d8f479faa7acc4669, user_id=e20f32b26dfb46a78ebd13869e427cd1, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.696018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.718010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a210330-b2ab-4a5d-90c3-dcabaa5bcd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e0d9c9fa234a679f27ede846d9c53e, user_id=71624d09c0cf4c5dbab27d15aba3cdd9, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.720902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a210330-b2ab-4a5d-90c3-dcabaa5bcd24 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.731840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 947/1893] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:07 2022] PUT /identity/v3/projects/9fc26a3fc2bb477d8f479faa7acc4669/users/e20f32b26dfb46a78ebd13869e427cd1/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:07.734385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:07.741654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:07.752154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 947/1894] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:07 2022] PUT /identity/v3/projects/40e0d9c9fa234a679f27ede846d9c53e/users/71624d09c0cf4c5dbab27d15aba3cdd9/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:07.754737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd92b-4654-4072-978a-30876f901e94 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.755305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd92b-4654-4072-978a-30876f901e94 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.756810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd92b-4654-4072-978a-30876f901e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.796582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a82fd92b-4654-4072-978a-30876f901e94 None None] MFA Rules not processed for user `e20f32b26dfb46a78ebd13869e427cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:07.797841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a82fd92b-4654-4072-978a-30876f901e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:07.844881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280883b-8b36-4ffc-b76e-fc8928152996 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:07.910650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 948/1895] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:07.910650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05824767-3467-41fc-bc1a-5f870ae1c7f2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.910650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05824767-3467-41fc-bc1a-5f870ae1c7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.910650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05824767-3467-41fc-bc1a-5f870ae1c7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.933290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:07.934085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:07.934487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:07.934920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] PATH_INFO: `/v3/projects/164e82481ed44ffeab20ffabb7e871ca` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:07.936539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=164e82481ed44ffeab20ffabb7e871ca)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:07.938637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:07.946337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-05824767-3467-41fc-bc1a-5f870ae1c7f2 None None] MFA Rules not processed for user `71624d09c0cf4c5dbab27d15aba3cdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:07.948267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-05824767-3467-41fc-bc1a-5f870ae1c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:07.993850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:08.024706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164e82481ed44ffeab20ffabb7e871ca', 'request_id': 'req-d2306477-e27d-4f40-935a-c5a1e33262aa'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.038440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164e82481ed44ffeab20ffabb7e871ca', 'request_id': 'req-d2306477-e27d-4f40-935a-c5a1e33262aa'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.046276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164e82481ed44ffeab20ffabb7e871ca', 'request_id': 'req-d2306477-e27d-4f40-935a-c5a1e33262aa'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.055605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 949/1896] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:08.057162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05824767-3467-41fc-bc1a-5f870ae1c7f2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.067290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] The token cache is being invalidate because project 164e82481ed44ffeab20ffabb7e871ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:08.067729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.068646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.071621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05824767-3467-41fc-bc1a-5f870ae1c7f2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.076543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 948/1897] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:07 2022] DELETE /identity/v3/projects/164e82481ed44ffeab20ffabb7e871ca => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:08.077723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.079332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.155434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:08.170736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d56c-74e1-454e-bf04-39ac594ce663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.173531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d56c-74e1-454e-bf04-39ac594ce663 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.174803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d56c-74e1-454e-bf04-39ac594ce663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.175524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d56c-74e1-454e-bf04-39ac594ce663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.179513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d56c-74e1-454e-bf04-39ac594ce663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.186985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d56c-74e1-454e-bf04-39ac594ce663 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.216111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2306477-e27d-4f40-935a-c5a1e33262aa admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.228408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.230339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.230339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.230668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.232240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.235242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.252939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 950/1898] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/projects => generated 355 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:08.266851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810e57b-cd4e-44ee-b6c6-69cfdff4afca None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.266851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810e57b-cd4e-44ee-b6c6-69cfdff4afca None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.266851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810e57b-cd4e-44ee-b6c6-69cfdff4afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.306553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6810e57b-cd4e-44ee-b6c6-69cfdff4afca None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:08.312417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 949/1899] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:08.312417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.314085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6810e57b-cd4e-44ee-b6c6-69cfdff4afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.327727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.455474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 951/1900] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:08.466870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810e57b-cd4e-44ee-b6c6-69cfdff4afca None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.488630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810e57b-cd4e-44ee-b6c6-69cfdff4afca None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.497351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab51e07-6e59-4d38-b411-a2bdbbe246d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.500770 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab51e07-6e59-4d38-b411-a2bdbbe246d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.501349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab51e07-6e59-4d38-b411-a2bdbbe246d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.501834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab51e07-6e59-4d38-b411-a2bdbbe246d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.502888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab51e07-6e59-4d38-b411-a2bdbbe246d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.505368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab51e07-6e59-4d38-b411-a2bdbbe246d9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.519597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e680c1b-c44a-4f68-992f-969c6a42b13d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.544422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 952/1901] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/users => generated 300 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:08.546390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.546900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.547717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.548221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.550805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.551171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.551451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.553631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.566190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.575789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:08.577689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.587223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 953/1902] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:08.592845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.595170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.608348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9c4a-6768-4216-b95e-170dd93151db None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.613865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.614114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 950/1903] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:08.615006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.615117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.615563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.616005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] PATH_INFO: `/v3/projects/e27fbe33b8834f3d9030ce0a5bee7bcb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.617609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27fbe33b8834f3d9030ce0a5bee7bcb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.619880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.648139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c041c-0d04-4559-9af4-3fd02262f5d7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.672640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.681530 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.681847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.682222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.682903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.692265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.698872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27fbe33b8834f3d9030ce0a5bee7bcb', 'request_id': 'req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.704538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 951/1904] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:08.705647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.706859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27fbe33b8834f3d9030ce0a5bee7bcb', 'request_id': 'req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.715920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27fbe33b8834f3d9030ce0a5bee7bcb', 'request_id': 'req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.719468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f470-6a69-4229-8f8c-17c925805acd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.729740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] The token cache is being invalidate because project e27fbe33b8834f3d9030ce0a5bee7bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:08.739425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:08.739731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.740953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:08.745300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 954/1905] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:08 2022] DELETE /identity/v3/projects/e27fbe33b8834f3d9030ce0a5bee7bcb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:08.751651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.756193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.802806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.803538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.803765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.804036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.804686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:08.804990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.806657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.809659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:08.818590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 952/1906] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:08.823175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.824834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.830488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f16d-96e4-460d-9bfa-4bd2e80eb41e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.835072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2e84-0119-42dd-b343-b438b7cfda09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.835690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2e84-0119-42dd-b343-b438b7cfda09 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.835967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2e84-0119-42dd-b343-b438b7cfda09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.836239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2e84-0119-42dd-b343-b438b7cfda09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.837287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d73676-fa3d-4792-a776-ab76b6ca917d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.837412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2e84-0119-42dd-b343-b438b7cfda09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.839388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2e84-0119-42dd-b343-b438b7cfda09 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.842263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.842953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.843234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.843510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] PATH_INFO: `/v3/projects/24528fc251944d96a6e289e51ff5dfbe/users/4883cbb5766b42408033732dacd436b0/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.849315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 955/1907] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:08.850599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991182d9-f13a-412b-914f-601b9956b45a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.850771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991182d9-f13a-412b-914f-601b9956b45a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.851057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991182d9-f13a-412b-914f-601b9956b45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.859656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24528fc251944d96a6e289e51ff5dfbe, user_id=4883cbb5766b42408033732dacd436b0, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.862661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.870964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-991182d9-f13a-412b-914f-601b9956b45a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:08.872161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-991182d9-f13a-412b-914f-601b9956b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.877122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 953/1908] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:08 2022] PUT /identity/v3/projects/24528fc251944d96a6e289e51ff5dfbe/users/4883cbb5766b42408033732dacd436b0/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:08.877904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.881011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:08.934237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 956/1909] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:08.935039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991182d9-f13a-412b-914f-601b9956b45a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.948366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807aac-65eb-4939-a6b2-4561288ca5c5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.948560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991182d9-f13a-412b-914f-601b9956b45a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:08.953021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea003a-1cdc-4bda-9ecc-efa2fed0ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.953150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:08.953709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea003a-1cdc-4bda-9ecc-efa2fed0ed42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.953829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.953981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea003a-1cdc-4bda-9ecc-efa2fed0ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.954069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.954254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea003a-1cdc-4bda-9ecc-efa2fed0ed42 admin admin] PATH_INFO: `/v3/projects/cbd02e6ac8ea4515ae570c09da065102/users/d9105698b8134138a7393c8d9688414b/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.954344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:08.954927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.956957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.969994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea003a-1cdc-4bda-9ecc-efa2fed0ed42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd02e6ac8ea4515ae570c09da065102, user_id=d9105698b8134138a7393c8d9688414b, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:08.972730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea003a-1cdc-4bda-9ecc-efa2fed0ed42 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:08.988194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 954/1910] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:08.988194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:08.988457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 957/1911] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:08 2022] PUT /identity/v3/projects/cbd02e6ac8ea4515ae570c09da065102/users/d9105698b8134138a7393c8d9688414b/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:08.988958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae44740-cd31-46b8-aa20-23c407b688fc None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:08.989240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae44740-cd31-46b8-aa20-23c407b688fc None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:08.989513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae44740-cd31-46b8-aa20-23c407b688fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.009122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-eae44740-cd31-46b8-aa20-23c407b688fc None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:09.011113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-eae44740-cd31-46b8-aa20-23c407b688fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:09.049333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ca6ca-7196-44dc-816d-2ff4e2efe021 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.054024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.054641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.054954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.055227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.055878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.057534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.067533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 955/1912] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:09.068408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.076364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 958/1913] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:09.077175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae44740-cd31-46b8-aa20-23c407b688fc None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.080069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ea29e-e969-47ac-9831-9619361e86d0 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.084946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.085543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.085837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.086110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.086411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae44740-cd31-46b8-aa20-23c407b688fc None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.086742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.088386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.090880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:09.091943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.092558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.092835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.093195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.094102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.096376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.101609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 956/1914] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:09.102370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.113291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e036e8a-d74c-4736-b84e-78cc921c42d5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.119133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.119788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.120073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.120195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 959/1915] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:09 2022] POST /identity/v3/users => generated 300 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:09.120366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] PATH_INFO: `/v3/projects/24528fc251944d96a6e289e51ff5dfbe/users/4883cbb5766b42408033732dacd436b0/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.120894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.122407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24528fc251944d96a6e289e51ff5dfbe, user_id=4883cbb5766b42408033732dacd436b0, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.125106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.130798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9d88-4fce-42a4-ae0e-b3b53fc2356c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.137085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 957/1916] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:09 2022] PUT /identity/v3/projects/24528fc251944d96a6e289e51ff5dfbe/users/4883cbb5766b42408033732dacd436b0/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:09.137933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.171891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:09.196909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.197463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.197743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.198009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.198659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:09.198984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.200590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.204156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe21b-2465-444b-afc3-9af6fe1aca94 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.209421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824d82-ca1a-48f4-8a03-902f8e2cc291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.210080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824d82-ca1a-48f4-8a03-902f8e2cc291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.210380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824d82-ca1a-48f4-8a03-902f8e2cc291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.210647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824d82-ca1a-48f4-8a03-902f8e2cc291 admin admin] PATH_INFO: `/v3/projects/cbd02e6ac8ea4515ae570c09da065102/users/d9105698b8134138a7393c8d9688414b/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.212004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 960/1917] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:09.212592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824d82-ca1a-48f4-8a03-902f8e2cc291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd02e6ac8ea4515ae570c09da065102, user_id=d9105698b8134138a7393c8d9688414b, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.212895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.215970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824d82-ca1a-48f4-8a03-902f8e2cc291 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.222489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147c91-10f1-4486-994c-c17c8f60b6a3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.226351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 958/1918] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:09 2022] PUT /identity/v3/projects/cbd02e6ac8ea4515ae570c09da065102/users/d9105698b8134138a7393c8d9688414b/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:09.227348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963756-0fad-4ef8-bb9b-b5fb293ebe38 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.227626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963756-0fad-4ef8-bb9b-b5fb293ebe38 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.227896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963756-0fad-4ef8-bb9b-b5fb293ebe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.260616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fe963756-0fad-4ef8-bb9b-b5fb293ebe38 None None] MFA Rules not processed for user `4883cbb5766b42408033732dacd436b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:09.261836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fe963756-0fad-4ef8-bb9b-b5fb293ebe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:09.278202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.278852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.279153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.279385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.280026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.281616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.295230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 961/1919] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:09.295230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.304655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a1bc5-567a-43dd-ac2f-2b1f657dbeb7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.310516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.311184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.311439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.311702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.312450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.314544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.343829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 959/1920] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:09.343829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.343829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.343829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.349905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 962/1921] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:09 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:09.349905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.375546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] MFA Rules not processed for user `d9105698b8134138a7393c8d9688414b`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:09.377148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:09.421409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af627b-7ef1-4eeb-ad80-b386252d5b75 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.426041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.426659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.426974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.427244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.427894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.429555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.440035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 963/1922] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:09.440832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.440939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:09.451924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8674f92-8900-47cf-b069-c7e6312d94eb admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.457078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.457701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.457975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.458773 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.459745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.461408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.468871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 960/1923] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:09.469670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.471028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:09.488232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 964/1924] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:09 2022] POST /identity/v3/users => generated 284 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:09.488935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.498929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a669-dc0e-4ef1-8a8b-8c88797a51c0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.504220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.504898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.505170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.505761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] PATH_INFO: `/v3/projects/0187944972564b6f86ff0f36eeb9e8cb/users/a311b6f7607d42f59d9c8e682553757a/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.523570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0187944972564b6f86ff0f36eeb9e8cb, user_id=a311b6f7607d42f59d9c8e682553757a, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.529112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.543144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:09.546119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136153-beb7-42d9-a7dd-0264a7773181 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.551569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 965/1925] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:09 2022] PUT /identity/v3/projects/0187944972564b6f86ff0f36eeb9e8cb/users/a311b6f7607d42f59d9c8e682553757a/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:09.553376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.556711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:09.648506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.650103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.650524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.650996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.660861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1534cc-a778-460a-988b-3b2bb5c34435 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.665909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fb402-ea81-45d6-b0e8-e4fa1bddcb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.666758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fb402-ea81-45d6-b0e8-e4fa1bddcb53 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.667127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fb402-ea81-45d6-b0e8-e4fa1bddcb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.667399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fb402-ea81-45d6-b0e8-e4fa1bddcb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.743195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.745338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.755897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fb402-ea81-45d6-b0e8-e4fa1bddcb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.756183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 961/1926] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:09.757189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.760539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fb402-ea81-45d6-b0e8-e4fa1bddcb53 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.776664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 966/1927] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:09.778293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.779817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.780104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.845791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] MFA Rules not processed for user `a311b6f7607d42f59d9c8e682553757a`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:09.849239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:09.883147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:09.892413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae4665-5b41-4316-bbb6-66211a909d1c service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.897360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.898000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.898652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.898652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.899214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.901092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.912708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 962/1928] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:09.913602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:09.924380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c52fed-8759-4bb6-83fe-e7554e24ad55 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:09.929652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:09.930459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:09.930741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:09.931041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] PATH_INFO: `/v3/users/71624d09c0cf4c5dbab27d15aba3cdd9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:09.932268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71624d09c0cf4c5dbab27d15aba3cdd9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:09.934217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:09.995100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71624d09c0cf4c5dbab27d15aba3cdd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:10.005955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71624d09c0cf4c5dbab27d15aba3cdd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:10.022621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71624d09c0cf4c5dbab27d15aba3cdd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:10.024035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71624d09c0cf4c5dbab27d15aba3cdd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:10.024668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71624d09c0cf4c5dbab27d15aba3cdd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:10.040931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 963/1929] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:09 2022] DELETE /identity/v3/users/71624d09c0cf4c5dbab27d15aba3cdd9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:10.041953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.045876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.080378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 967/1930] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:10.084591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.085978 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.102352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6cb50-1574-4cc4-b1cc-4ff16bd76bce None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.151294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:10.165490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.166082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.166422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.166682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.168735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.169406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb80e-569e-432a-8bef-406e02c3af77 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.174769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b328b-9b2a-4d9f-ab70-1b0fcfbc3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.175659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b328b-9b2a-4d9f-ab70-1b0fcfbc3605 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.176005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b328b-9b2a-4d9f-ab70-1b0fcfbc3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.176980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b328b-9b2a-4d9f-ab70-1b0fcfbc3605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.177926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b328b-9b2a-4d9f-ab70-1b0fcfbc3605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.180266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b328b-9b2a-4d9f-ab70-1b0fcfbc3605 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.192004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 964/1931] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:10.193558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.194310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.194935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.217696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:10.219143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.227160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 965/1932] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:10.228394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.229865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.243546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71108b7-8bed-4bdf-a423-191b71ba8373 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.245165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.246985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.248789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.249043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.249472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.249748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.250392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.252391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.257547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 968/1933] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:10.259098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.272809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472adae7-04c6-4d9a-a347-cfea332e48b8 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.281755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.282729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.283301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.283752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] PATH_INFO: `/v3/projects/0f2a1ba25d0546d2990920a623c8cbc3/users/1be258f5033041c9801a466ecff540a9/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.289742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 966/1934] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:10 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:10.289742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.291966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.306987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a1ba25d0546d2990920a623c8cbc3, user_id=1be258f5033041c9801a466ecff540a9, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.310075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.327286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 969/1935] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:10 2022] PUT /identity/v3/projects/0f2a1ba25d0546d2990920a623c8cbc3/users/1be258f5033041c9801a466ecff540a9/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:10.328030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.341731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:10.368716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042e78e-1015-4724-b1c1-474a944d4941 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.413836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f0d1-14d0-48df-9704-1998acbade75 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.421505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d4750-1d06-4d90-b310-fe83643a8bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.427104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4750-1d06-4d90-b310-fe83643a8bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.427418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4750-1d06-4d90-b310-fe83643a8bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.427723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4750-1d06-4d90-b310-fe83643a8bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.428396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d4750-1d06-4d90-b310-fe83643a8bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.430380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d4750-1d06-4d90-b310-fe83643a8bb4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.455468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.456176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.456491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.456763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.469226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 970/1936] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:10 2022] POST /identity/v3/users => generated 307 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:10.471021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.471259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff673a-3502-49e7-9abe-ac5e9734e0c6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.472100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff673a-3502-49e7-9abe-ac5e9734e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.472550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff673a-3502-49e7-9abe-ac5e9734e0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.472726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.484469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 967/1937] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:10.485350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.495796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7c40-0809-4206-820d-bc6a762cb448 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.501963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.502595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.502908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.503353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.504012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.506692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.514565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-beff673a-3502-49e7-9abe-ac5e9734e0c6 None None] MFA Rules not processed for user `1be258f5033041c9801a466ecff540a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:10.516861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-beff673a-3502-49e7-9abe-ac5e9734e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.518413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 968/1938] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:10.522608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.534080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52b56b-b486-459c-bc60-5f23fa51426b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.539383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.540084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.540663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.540663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] PATH_INFO: `/v3/projects/5c99c88c548944ab8ca507d38ddf9fb5/users/63e68aca07504ee0a742dfe6df000692/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.560049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c99c88c548944ab8ca507d38ddf9fb5, user_id=63e68aca07504ee0a742dfe6df000692, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.562776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.571725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:10.580173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 969/1939] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:10 2022] PUT /identity/v3/projects/5c99c88c548944ab8ca507d38ddf9fb5/users/63e68aca07504ee0a742dfe6df000692/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:10.584140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.596827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 971/1940] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:10.601938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff673a-3502-49e7-9abe-ac5e9734e0c6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.616507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff673a-3502-49e7-9abe-ac5e9734e0c6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.676294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd187c-72c8-4613-b24c-7ecc7dfb3da4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.682493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.683208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.683896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.684181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.684841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.686446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.697884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 970/1941] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:10.702165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.717879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229c98e-da1f-48ab-9fc9-0ca0bcf5fb65 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.718478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.719141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.719475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.719680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.720321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.722227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.724366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269707-0548-420e-b46a-ee36c4300ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.725386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269707-0548-420e-b46a-ee36c4300ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.725823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269707-0548-420e-b46a-ee36c4300ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.726362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269707-0548-420e-b46a-ee36c4300ddd admin admin] PATH_INFO: `/v3/projects/5c99c88c548944ab8ca507d38ddf9fb5/users/63e68aca07504ee0a742dfe6df000692/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.728924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269707-0548-420e-b46a-ee36c4300ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c99c88c548944ab8ca507d38ddf9fb5, user_id=63e68aca07504ee0a742dfe6df000692, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.732630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269707-0548-420e-b46a-ee36c4300ddd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.745079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 971/1942] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:10 2022] PUT /identity/v3/projects/5c99c88c548944ab8ca507d38ddf9fb5/users/63e68aca07504ee0a742dfe6df000692/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:10.756630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.756920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.757219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.760093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 972/1943] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:10 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:10.764598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.795912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] MFA Rules not processed for user `63e68aca07504ee0a742dfe6df000692`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:10.797175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.836698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:10.864143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2e75e-953c-431f-9a86-d74aa2c08a33 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.873332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.874111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.874493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.874905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.875795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.877890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.892605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 972/1944] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:10.897385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.897385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:10.917674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79958b4-0ba9-4de1-9062-b088627d80e5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.923897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:10.924144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 973/1945] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:10 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:10.924982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:10.925092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:10.925324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:10.925604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] PATH_INFO: `/v3/projects/40e0d9c9fa234a679f27ede846d9c53e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:10.926759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e0d9c9fa234a679f27ede846d9c53e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:10.929124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:10.980777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e0d9c9fa234a679f27ede846d9c53e', 'request_id': 'req-638cc8f5-4697-4ed3-baab-306e1f328580'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:10.982317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b336bd-1ca6-4fdc-a624-8e1aed6014e8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:10.991605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e0d9c9fa234a679f27ede846d9c53e', 'request_id': 'req-638cc8f5-4697-4ed3-baab-306e1f328580'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:10.999172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e0d9c9fa234a679f27ede846d9c53e', 'request_id': 'req-638cc8f5-4697-4ed3-baab-306e1f328580'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.003453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:11.012951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] The token cache is being invalidate because project 40e0d9c9fa234a679f27ede846d9c53e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:11.013234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.014030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.018666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 973/1946] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:10 2022] DELETE /identity/v3/projects/40e0d9c9fa234a679f27ede846d9c53e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:11.018666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.018666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.044977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.045716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.046063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.046401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.050270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.091327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cc8f5-4697-4ed3-baab-306e1f328580 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.096086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.096951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.097755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.098360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.099109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.100864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.113184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 974/1947] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:11.114056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.116543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.119068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.120644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.130580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a740-9d02-4a6e-a385-86d9b3472237 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.136091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.136811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.137166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.137494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 974/1948] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:10 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:11.137608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] PATH_INFO: `/v3/users/4883cbb5766b42408033732dacd436b0` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.138684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.139436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4883cbb5766b42408033732dacd436b0)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.141380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.151798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e638c0a-ee8d-4891-b0a5-e11089bbdc26 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.166490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.167213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.167492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.170997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] PATH_INFO: `/v3/projects/eb555c2a324a4b478538e5db2895ffb7/users/2b6e13b81c2140f9984f88ec861d010a/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.208864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb555c2a324a4b478538e5db2895ffb7, user_id=2b6e13b81c2140f9984f88ec861d010a, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.213734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.217455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:11.235321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4883cbb5766b42408033732dacd436b0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.239545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 975/1949] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:11 2022] PUT /identity/v3/projects/eb555c2a324a4b478538e5db2895ffb7/users/2b6e13b81c2140f9984f88ec861d010a/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:11.246484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.250007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4883cbb5766b42408033732dacd436b0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.263230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4883cbb5766b42408033732dacd436b0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.264238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4883cbb5766b42408033732dacd436b0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.265220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4883cbb5766b42408033732dacd436b0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:11.281289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 975/1950] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:11 2022] DELETE /identity/v3/users/4883cbb5766b42408033732dacd436b0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:11.285198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.286804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.321039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d0b86-20dd-44ac-8b86-b43e47109372 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.361107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31b80-5fcd-4e14-aa22-d7904d224a52 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.365251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46496-5ef7-4adf-8291-adeda009bfc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.365984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46496-5ef7-4adf-8291-adeda009bfc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.366945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46496-5ef7-4adf-8291-adeda009bfc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.367304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46496-5ef7-4adf-8291-adeda009bfc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.369764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-01c46496-5ef7-4adf-8291-adeda009bfc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.390611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:11.403759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.404469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.404831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.405087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.406174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.410248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.431373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 976/1951] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:11.435508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.437898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.465072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe149-356c-4371-8b5a-3c01c75c4137 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.465260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c46496-5ef7-4adf-8291-adeda009bfc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.467602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c46496-5ef7-4adf-8291-adeda009bfc1 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.470883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.471577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.471855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.472258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] PATH_INFO: `/v3/projects/eb555c2a324a4b478538e5db2895ffb7/users/2b6e13b81c2140f9984f88ec861d010a/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.474420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb555c2a324a4b478538e5db2895ffb7, user_id=2b6e13b81c2140f9984f88ec861d010a, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.477119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.481491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 976/1952] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:11.493007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 977/1953] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:11 2022] PUT /identity/v3/projects/eb555c2a324a4b478538e5db2895ffb7/users/2b6e13b81c2140f9984f88ec861d010a/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:11.518041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.518360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.518641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.563422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] MFA Rules not processed for user `2b6e13b81c2140f9984f88ec861d010a`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:11.565166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.653436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:11.670812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 977/1954] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:11.716133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.718957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.743357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:11.745151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:11.812494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd3ec-0317-4be1-bd78-9b47f40c2363 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.816642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.817378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.817778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.818143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.830023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.832638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.850055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 978/1955] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:11.911880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf2345-3bfb-4b8c-ba40-a343cc98c6b2 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:11.916810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:11.917534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:11.917905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:11.918236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] PATH_INFO: `/v3/projects/24528fc251944d96a6e289e51ff5dfbe` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:11.919474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24528fc251944d96a6e289e51ff5dfbe)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:11.921552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:11.989083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:12.000868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39df8-a0d5-4c1a-9dc5-8d23f81bf087 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:12.030889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24528fc251944d96a6e289e51ff5dfbe', 'request_id': 'req-a03c97c7-3a8e-49e5-8093-2d51d118a34a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:12.050119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24528fc251944d96a6e289e51ff5dfbe', 'request_id': 'req-a03c97c7-3a8e-49e5-8093-2d51d118a34a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:12.058126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24528fc251944d96a6e289e51ff5dfbe', 'request_id': 'req-a03c97c7-3a8e-49e5-8093-2d51d118a34a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:12.080287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f01ac-5395-41fc-ab12-2f3c8643bd5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:12.081865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f01ac-5395-41fc-ab12-2f3c8643bd5b service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.081865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f01ac-5395-41fc-ab12-2f3c8643bd5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.081865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f01ac-5395-41fc-ab12-2f3c8643bd5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.083119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] The token cache is being invalidate because project 24528fc251944d96a6e289e51ff5dfbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:12.083415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:12.093119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-113f01ac-5395-41fc-ab12-2f3c8643bd5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:12.096492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a03c97c7-3a8e-49e5-8093-2d51d118a34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:12.099205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 978/1956] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:11 2022] DELETE /identity/v3/projects/24528fc251944d96a6e289e51ff5dfbe => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:12.105012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1accd-1228-4260-b9aa-54e60d09ed3d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.105527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1accd-1228-4260-b9aa-54e60d09ed3d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.105891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1accd-1228-4260-b9aa-54e60d09ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.132549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-26a1accd-1228-4260-b9aa-54e60d09ed3d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:12.133864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-26a1accd-1228-4260-b9aa-54e60d09ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:12.176901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f01ac-5395-41fc-ab12-2f3c8643bd5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:12.178090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f01ac-5395-41fc-ab12-2f3c8643bd5b service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:12.195746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 979/1957] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:12.215115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 979/1958] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:12.223810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0688-2818-4ccf-bf73-922a24a90227 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.223810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0688-2818-4ccf-bf73-922a24a90227 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.224089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0688-2818-4ccf-bf73-922a24a90227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.245690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e7aa0688-2818-4ccf-bf73-922a24a90227 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:12.246873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e7aa0688-2818-4ccf-bf73-922a24a90227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:12.255225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 980/1959] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:12.260069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1accd-1228-4260-b9aa-54e60d09ed3d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:12.279513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1accd-1228-4260-b9aa-54e60d09ed3d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:12.292519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:12.293584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.293869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.294242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.294796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:12.295136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:12.297563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:12.320257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 980/1960] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:12.321208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa0688-2818-4ccf-bf73-922a24a90227 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:12.334789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa0688-2818-4ccf-bf73-922a24a90227 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:12.346411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:12.348394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.348780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.349162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.350281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:12.352566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:12.423331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 981/1961] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:12 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:12.427394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:12.442229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209762dd-6691-4d4d-b84d-6fa6f303e896 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:12.473103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:12.543205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:12.543982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.544331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.544676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.545397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:12.547637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:12.582307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 981/1962] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:12 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:12.586637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:12.594913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:12.605695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c58bb0-c1e7-4b29-bfed-f9993b8b43e2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:12.613268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:12.613855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.614383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.616765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.617590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:12.623268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:12.641844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 982/1963] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:12.642895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:12.655057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a016-73f6-4ca1-8dab-756a814d2c2e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:12.660435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49408-95d9-4fe1-92f0-5f7464e278f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:12.660780 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49408-95d9-4fe1-92f0-5f7464e278f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.661058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49408-95d9-4fe1-92f0-5f7464e278f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.661328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49408-95d9-4fe1-92f0-5f7464e278f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.667378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49408-95d9-4fe1-92f0-5f7464e278f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:12.670267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49408-95d9-4fe1-92f0-5f7464e278f4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:12.692911 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 982/1964] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:12.697006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:12.710474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fc1a9-952d-4a3b-9495-e4c8bbab6d29 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:12.725109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:12.726287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.726582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.726957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] PATH_INFO: `/v3/projects/35f94fc9da7c489b89c96702a651120a/users/9825a559cc844c7d9417205e82f688cf/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.748627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f94fc9da7c489b89c96702a651120a, user_id=9825a559cc844c7d9417205e82f688cf, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:12.754994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:12.766787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 983/1965] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:12 2022] PUT /identity/v3/projects/35f94fc9da7c489b89c96702a651120a/users/9825a559cc844c7d9417205e82f688cf/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:12.776674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d079a-7ca0-4d22-bc5c-f497f119d870 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:12.776959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d079a-7ca0-4d22-bc5c-f497f119d870 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:12.777232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d079a-7ca0-4d22-bc5c-f497f119d870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:12.836704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec7d079a-7ca0-4d22-bc5c-f497f119d870 None None] MFA Rules not processed for user `9825a559cc844c7d9417205e82f688cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:12.840721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec7d079a-7ca0-4d22-bc5c-f497f119d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:12.947630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 983/1966] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:12.952212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.031253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a1cd-db8e-4463-a707-1f74693657b8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.036084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.036838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.037163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.037431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.038067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.040505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.073590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 984/1967] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:12 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:13.078089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d079a-7ca0-4d22-bc5c-f497f119d870 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.090714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d079a-7ca0-4d22-bc5c-f497f119d870 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.186219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.187054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.187328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.187632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.188244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.190174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.222635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 984/1968] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:13 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:13.226483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.252331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06260185-19ff-4a53-8e4c-507ca2bd41ec admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.261141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.262378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.262755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.263164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.264086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.265754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.280547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 985/1969] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:13.283293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.302383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7a31-a90a-4b4b-95c4-8307bace480d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.308256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a98444-b52b-4768-a4f2-302709b01d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.309013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98444-b52b-4768-a4f2-302709b01d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.309388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98444-b52b-4768-a4f2-302709b01d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.310058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98444-b52b-4768-a4f2-302709b01d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.311718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a98444-b52b-4768-a4f2-302709b01d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.314931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a98444-b52b-4768-a4f2-302709b01d47 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.322450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:13.340623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 985/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:13.345145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.356927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81298cfa-f721-4398-91ec-158960f934b5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.363359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.364241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.364605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.364974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] PATH_INFO: `/v3/projects/98b2ba08700a48338b25f0054fa61acf/users/376251823cfc4b44ba99e548ef996eac/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.384650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b2ba08700a48338b25f0054fa61acf, user_id=376251823cfc4b44ba99e548ef996eac, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.388030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.409278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 986/1971] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:13 2022] PUT /identity/v3/projects/98b2ba08700a48338b25f0054fa61acf/users/376251823cfc4b44ba99e548ef996eac/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:13.421482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dd4d-e9ed-4682-82e7-eda1ad52ad21 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.422033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dd4d-e9ed-4682-82e7-eda1ad52ad21 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.422519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dd4d-e9ed-4682-82e7-eda1ad52ad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.465509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ffe0dd4d-e9ed-4682-82e7-eda1ad52ad21 None None] MFA Rules not processed for user `376251823cfc4b44ba99e548ef996eac`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:13.467865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ffe0dd4d-e9ed-4682-82e7-eda1ad52ad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:13.570275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 986/1972] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:13.570410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.645837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb872d99-ce33-4747-bbc9-7f7ca8dffc7c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.651391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.652078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.652678 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.652919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.653676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.655798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.692801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0dd4d-e9ed-4682-82e7-eda1ad52ad21 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.699161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 987/1973] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:13 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:13.708788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0dd4d-e9ed-4682-82e7-eda1ad52ad21 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.781640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.782577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.783276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.783645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.784376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.786684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.845783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 987/1974] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:13 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:13.850566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.861761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:13.867525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8ce4e-e9ec-4aa1-bf5c-1a20a2832d53 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.877550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.878798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.879281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.879653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.880436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.883074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.911123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 988/1975] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:13.916545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:13.929852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9da4b-8ae6-4dbe-9d92-23024d662b16 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:13.936371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:13.937659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:13.937941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:13.938222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] PATH_INFO: `/v3/projects/45a1f178dd9a4664a7247cc19f655889/users/25e011b093544f79a00e69e67c7a35e0/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:13.967194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a1f178dd9a4664a7247cc19f655889, user_id=25e011b093544f79a00e69e67c7a35e0, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:13.971526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:13.993661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 988/1976] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:13 2022] PUT /identity/v3/projects/45a1f178dd9a4664a7247cc19f655889/users/25e011b093544f79a00e69e67c7a35e0/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:13.997727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:14.008929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f1cc-904a-47ea-9ac4-40128ee1c1de admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:14.116859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b949-2dcf-4312-adf5-23d791737de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:14.119021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b949-2dcf-4312-adf5-23d791737de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:14.120136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b949-2dcf-4312-adf5-23d791737de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:14.123060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b949-2dcf-4312-adf5-23d791737de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:14.125255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b949-2dcf-4312-adf5-23d791737de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:14.127215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b949-2dcf-4312-adf5-23d791737de3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:14.143858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 989/1977] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:14.144812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:14.163621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8150ff-3f83-4065-bd39-31f86a6f9ccb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:14.178289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:14.179026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:14.179354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:14.179700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] PATH_INFO: `/v3/projects/45a1f178dd9a4664a7247cc19f655889/users/25e011b093544f79a00e69e67c7a35e0/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:14.181673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a1f178dd9a4664a7247cc19f655889, user_id=25e011b093544f79a00e69e67c7a35e0, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:14.184538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:14.197115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 989/1978] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:14 2022] PUT /identity/v3/projects/45a1f178dd9a4664a7247cc19f655889/users/25e011b093544f79a00e69e67c7a35e0/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:14.210106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaf1ac-9db8-4688-92ae-095c62296952 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:14.210430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaf1ac-9db8-4688-92ae-095c62296952 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:14.210709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaf1ac-9db8-4688-92ae-095c62296952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:14.260469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-33aaf1ac-9db8-4688-92ae-095c62296952 None None] MFA Rules not processed for user `25e011b093544f79a00e69e67c7a35e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:14.262705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-33aaf1ac-9db8-4688-92ae-095c62296952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:14.371860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 990/1979] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:14.395545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:14.397332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:14.442321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:14.458063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7461-157c-47bb-8fd1-876241d0bba3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:14.461968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:14.462755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:14.463013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:14.463436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:14.474851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:14.476519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:14.486246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 990/1980] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:14.568179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaf1ac-9db8-4688-92ae-095c62296952 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:14.579058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaf1ac-9db8-4688-92ae-095c62296952 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:14.584236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7d8ce-a7d8-4e93-957c-2e8c8e4ef229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:14.584989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d8ce-a7d8-4e93-957c-2e8c8e4ef229 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:14.585383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d8ce-a7d8-4e93-957c-2e8c8e4ef229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:14.586923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d8ce-a7d8-4e93-957c-2e8c8e4ef229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:14.721282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7d8ce-a7d8-4e93-957c-2e8c8e4ef229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:14.733526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7d8ce-a7d8-4e93-957c-2e8c8e4ef229 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:14.745234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 991/1981] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:16.704602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:16.706083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:16.840372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ea7a-1e1e-4f90-a236-f9a7bff5bee3 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:16.845405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:16.846213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:16.846511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:16.846882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] PATH_INFO: `/v3/users/a311b6f7607d42f59d9c8e682553757a` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:16.848207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a311b6f7607d42f59d9c8e682553757a)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:16.850176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:16.942067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a311b6f7607d42f59d9c8e682553757a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:16.953049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a311b6f7607d42f59d9c8e682553757a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:16.966653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a311b6f7607d42f59d9c8e682553757a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:16.967781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a311b6f7607d42f59d9c8e682553757a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:16.968964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a311b6f7607d42f59d9c8e682553757a'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:16.987646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:16.988210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:16.988210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:16.991045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 991/1982] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:16 2022] DELETE /identity/v3/users/a311b6f7607d42f59d9c8e682553757a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:17.022946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:17.024463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:17.033713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:17.090465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 992/1983] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:17.100421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:17.102137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:17.162305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20fb63-3faa-4603-9a27-d88a2dd804dd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:17.166108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:17.166812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:17.167117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:17.167387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:17.177495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:17.179171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:17.198417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 992/1984] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:17.559913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:17.561373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:17.573767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a082566-22ec-4aa3-b659-34a92e70776f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:17.579697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:17.581400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:17.583349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:17.583496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] PATH_INFO: `/v3/projects/0187944972564b6f86ff0f36eeb9e8cb` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:17.584945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0187944972564b6f86ff0f36eeb9e8cb)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:17.588224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:17.647217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0187944972564b6f86ff0f36eeb9e8cb', 'request_id': 'req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.655800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0187944972564b6f86ff0f36eeb9e8cb', 'request_id': 'req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.664053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0187944972564b6f86ff0f36eeb9e8cb', 'request_id': 'req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.676328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] The token cache is being invalidate because project 0187944972564b6f86ff0f36eeb9e8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:17.676616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.677328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.678967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 993/1985] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:17 2022] DELETE /identity/v3/projects/0187944972564b6f86ff0f36eeb9e8cb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:17.683100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:17.690246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:17.694469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760618f-4072-4674-a3cc-9305ff31df2b service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:17.801223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:17.801907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:17.802448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:17.802871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] PATH_INFO: `/v3/users/63e68aca07504ee0a742dfe6df000692` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:17.804502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e68aca07504ee0a742dfe6df000692)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:17.807091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:17.887246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e68aca07504ee0a742dfe6df000692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.901171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e68aca07504ee0a742dfe6df000692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.922460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e68aca07504ee0a742dfe6df000692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.923825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e68aca07504ee0a742dfe6df000692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.939244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:17.939244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:17.939667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e68aca07504ee0a742dfe6df000692'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:17.947333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f11e-d2f3-4d2c-a7fa-23c96de0edce admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:17.957720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 993/1986] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:17 2022] DELETE /identity/v3/users/63e68aca07504ee0a742dfe6df000692 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:17.964884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:17.965554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:17.965835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:17.966112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] PATH_INFO: `/v3/users/1be258f5033041c9801a466ecff540a9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:17.972284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be258f5033041c9801a466ecff540a9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:17.973451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:18.075397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be258f5033041c9801a466ecff540a9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.084402 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:18.086184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.105119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be258f5033041c9801a466ecff540a9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.106322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be258f5033041c9801a466ecff540a9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.107422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be258f5033041c9801a466ecff540a9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.130100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bab8034b-a4a4-4162-9694-ced17e4ec38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be258f5033041c9801a466ecff540a9'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.171498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 994/1987] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:17 2022] DELETE /identity/v3/users/1be258f5033041c9801a466ecff540a9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:18.181222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:18.181889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:18.182200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:18.218213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512a3ef-14b2-4834-951a-d935c6b6cdd3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:18.250620 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:18.252583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:18.254488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.267747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:18.317494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:18.318457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:18.318709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:18.319009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] PATH_INFO: `/v3/users/9825a559cc844c7d9417205e82f688cf` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:18.320735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9825a559cc844c7d9417205e82f688cf)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:18.323054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:18.428579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 995/1988] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:18.438084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9825a559cc844c7d9417205e82f688cf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.454095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:18.455661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.459160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9825a559cc844c7d9417205e82f688cf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.482405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9825a559cc844c7d9417205e82f688cf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.483493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9825a559cc844c7d9417205e82f688cf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.484497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c23c5b96-7e9d-4f0c-930d-ca2d1f246b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9825a559cc844c7d9417205e82f688cf'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.512339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 994/1989] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:18 2022] DELETE /identity/v3/users/9825a559cc844c7d9417205e82f688cf => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:18.514226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:18.514417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:18.514635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:18.549015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:18.550724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.561932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328791c-941c-4977-bf29-ca20a787e274 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:18.638788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:18.639443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:18.639729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:18.640005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:18.641823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.650360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 995/1990] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:18.650360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:18.650360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.662903 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:18.664391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:18.677357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 996/1991] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:18.678272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bca16-fb4b-4545-bdb7-2ef1e6cadcc5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:18.678389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:18.680072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.690362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:18.691053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:18.691328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:18.691604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] PATH_INFO: `/v3/projects/5c99c88c548944ab8ca507d38ddf9fb5` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:18.693227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c99c88c548944ab8ca507d38ddf9fb5)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:18.694642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279c2c3-5d2d-4483-9144-79e691b37904 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:18.695201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:18.699542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f046e3-0633-4d94-b975-b3da0e16cf60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:18.700337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f046e3-0633-4d94-b975-b3da0e16cf60 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:18.700681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f046e3-0633-4d94-b975-b3da0e16cf60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:18.701014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f046e3-0633-4d94-b975-b3da0e16cf60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:18.712981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f046e3-0633-4d94-b975-b3da0e16cf60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:18.716242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f046e3-0633-4d94-b975-b3da0e16cf60 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:18.740584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 997/1992] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:18.757061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:18.761667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c99c88c548944ab8ca507d38ddf9fb5', 'request_id': 'req-3e3ac00f-2a81-497a-9e70-24b352535180'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.809311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c99c88c548944ab8ca507d38ddf9fb5', 'request_id': 'req-3e3ac00f-2a81-497a-9e70-24b352535180'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.840066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c99c88c548944ab8ca507d38ddf9fb5', 'request_id': 'req-3e3ac00f-2a81-497a-9e70-24b352535180'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.864648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] The token cache is being invalidate because project 5c99c88c548944ab8ca507d38ddf9fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:18.865870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.867293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-3e3ac00f-2a81-497a-9e70-24b352535180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:18.874945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 996/1993] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:18 2022] DELETE /identity/v3/projects/5c99c88c548944ab8ca507d38ddf9fb5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:18.879112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899804c-fb87-4aa5-8672-1616fe530643 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:18.879560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899804c-fb87-4aa5-8672-1616fe530643 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:18.879929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899804c-fb87-4aa5-8672-1616fe530643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:18.911834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9899804c-fb87-4aa5-8672-1616fe530643 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:18.913312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9899804c-fb87-4aa5-8672-1616fe530643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:18.982254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:19.008662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 998/1994] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:19.011891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d39cb-d54c-4f9a-80b5-c66091bc77bf None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.012169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d39cb-d54c-4f9a-80b5-c66091bc77bf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.012436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d39cb-d54c-4f9a-80b5-c66091bc77bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.036098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0d8d39cb-d54c-4f9a-80b5-c66091bc77bf None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:19.037576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0d8d39cb-d54c-4f9a-80b5-c66091bc77bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:19.046434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 997/1995] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:19.050605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899804c-fb87-4aa5-8672-1616fe530643 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.062214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899804c-fb87-4aa5-8672-1616fe530643 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.071540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.072185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.072496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.072766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.073425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:19.073778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.075598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.091846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 999/1996] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:19.095878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d39cb-d54c-4f9a-80b5-c66091bc77bf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.108944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d39cb-d54c-4f9a-80b5-c66091bc77bf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.116079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.116796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.117147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.117497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.118511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.120442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.155245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 998/1997] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:19 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:19.156868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.168046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90c3e-48e9-44a6-ab26-bda59d176f26 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.223781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.225793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:19.257190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.258362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.259674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.260037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.260770 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.262742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.301961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1000/1998] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:19 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:19.301961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.302621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:19.316348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e9d7e-af34-4766-afdd-7d1d51bcfa71 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.322225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.322986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.323376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.323648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] PATH_INFO: `/v3/projects/35f94fc9da7c489b89c96702a651120a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.332443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f94fc9da7c489b89c96702a651120a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.334674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.362337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f9d3-ad3c-41e7-976d-eb5ca706f75c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.369169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.370099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.370475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.370927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] PATH_INFO: `/v3/projects/0f2a1ba25d0546d2990920a623c8cbc3` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.372427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2a1ba25d0546d2990920a623c8cbc3)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.374699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.426900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f94fc9da7c489b89c96702a651120a', 'request_id': 'req-b8ae572d-e88a-4318-8b87-8e28515f8af1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.433372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f94fc9da7c489b89c96702a651120a', 'request_id': 'req-b8ae572d-e88a-4318-8b87-8e28515f8af1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.444187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f94fc9da7c489b89c96702a651120a', 'request_id': 'req-b8ae572d-e88a-4318-8b87-8e28515f8af1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.465732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] The token cache is being invalidate because project 35f94fc9da7c489b89c96702a651120a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:19.466201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.467065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.468467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2a1ba25d0546d2990920a623c8cbc3', 'request_id': 'req-4db31546-7f89-4f40-aa2d-b18b05136c9d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.478769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1001/1999] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:19 2022] DELETE /identity/v3/projects/35f94fc9da7c489b89c96702a651120a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:19.478769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.480261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:19.490527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2a1ba25d0546d2990920a623c8cbc3', 'request_id': 'req-4db31546-7f89-4f40-aa2d-b18b05136c9d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.500134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2a1ba25d0546d2990920a623c8cbc3', 'request_id': 'req-4db31546-7f89-4f40-aa2d-b18b05136c9d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.514328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] The token cache is being invalidate because project 0f2a1ba25d0546d2990920a623c8cbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:19.514658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.515352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.520806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 999/2000] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:19 2022] DELETE /identity/v3/projects/0f2a1ba25d0546d2990920a623c8cbc3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:19.521763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.523405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:19.590991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:19.604043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:19.604907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae572d-e88a-4318-8b87-8e28515f8af1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.649572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31546-7f89-4f40-aa2d-b18b05136c9d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.655250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.656345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.656624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.656895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] PATH_INFO: `/v3/users/376251823cfc4b44ba99e548ef996eac` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.658195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376251823cfc4b44ba99e548ef996eac)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.663260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.746590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.747534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.749055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.749292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.749976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.756954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.761320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376251823cfc4b44ba99e548ef996eac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.787496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1002/2001] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:19.788570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.788683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376251823cfc4b44ba99e548ef996eac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.792999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:19.811759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376251823cfc4b44ba99e548ef996eac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.813608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376251823cfc4b44ba99e548ef996eac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.815510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376251823cfc4b44ba99e548ef996eac'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.823679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63da3-c021-4b35-a2cf-6b0c7106d9ed admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:19.831715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:19.832539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:19.832824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:19.833100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] PATH_INFO: `/v3/users/2b6e13b81c2140f9984f88ec861d010a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:19.834552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6e13b81c2140f9984f88ec861d010a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:19.837494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:19.847315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1000/2002] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:19 2022] DELETE /identity/v3/users/376251823cfc4b44ba99e548ef996eac => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:19.852187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:19.855071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:19.952772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6e13b81c2140f9984f88ec861d010a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.980281 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6e13b81c2140f9984f88ec861d010a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.981030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6e13b81c2140f9984f88ec861d010a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.981803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6e13b81c2140f9984f88ec861d010a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:19.992388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6e13b81c2140f9984f88ec861d010a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:20.010959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1458312-ae2c-4b70-9296-8edd3c9f2dc6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:20.016835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c25f31-ae84-42b4-b608-555a891704c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:20.017476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c25f31-ae84-42b4-b608-555a891704c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.017753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c25f31-ae84-42b4-b608-555a891704c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.018104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c25f31-ae84-42b4-b608-555a891704c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.018857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c25f31-ae84-42b4-b608-555a891704c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:20.020646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c25f31-ae84-42b4-b608-555a891704c7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:20.031671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1003/2003] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:19 2022] DELETE /identity/v3/users/2b6e13b81c2140f9984f88ec861d010a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:20.035914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1001/2004] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:20.042499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.045003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:20.239344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa350f-ff37-4b67-b55f-c5f8a7902666 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:20.248096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:20.249228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.249706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.250255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] PATH_INFO: `/v3/projects/c944dce649554a638cea4f7058a9a332/users/dc2a6e5ac48449aa9bed24a61f6c9330/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.274686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944dce649554a638cea4f7058a9a332, user_id=dc2a6e5ac48449aa9bed24a61f6c9330, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:20.278459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:20.282372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:20.305228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1004/2005] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:20 2022] PUT /identity/v3/projects/c944dce649554a638cea4f7058a9a332/users/dc2a6e5ac48449aa9bed24a61f6c9330/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:20.316669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce28a2-bea4-44c2-971f-40c162416008 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.316953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce28a2-bea4-44c2-971f-40c162416008 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.317228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce28a2-bea4-44c2-971f-40c162416008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.352880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f4ce28a2-bea4-44c2-971f-40c162416008 None None] MFA Rules not processed for user `dc2a6e5ac48449aa9bed24a61f6c9330`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:20.354512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f4ce28a2-bea4-44c2-971f-40c162416008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:20.409905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:20.463213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1002/2006] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:20.466493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.537805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead3ade-a527-42d1-afeb-d1a5580a3238 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:20.543564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:20.544200 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.544522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.544741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.545449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:20.547613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:20.596781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1005/2007] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:20 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:20.597799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce28a2-bea4-44c2-971f-40c162416008 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.610550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce28a2-bea4-44c2-971f-40c162416008 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:20.678598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.680957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:20.710663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:20.716570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.716570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.716570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.716570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:20.716570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:20.788149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1003/2008] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:20 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:20.794605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.817226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deff01-270f-4f3b-a8b8-d592236ce35d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:20.838651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:20.839896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.840963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.841236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.841917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:20.845517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:20.855474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c50aed-260e-4a4a-91c5-72e9db4bffea admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:20.867693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1004/2009] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:20.869285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:20.870198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.870577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.872809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] PATH_INFO: `/v3/projects/98b2ba08700a48338b25f0054fa61acf` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.874778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b2ba08700a48338b25f0054fa61acf)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:20.877165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.878964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:20.897915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece73315-7a1f-4018-8690-41a8cbcad8e6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:20.907026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:20.909166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:20.909682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:20.910170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] PATH_INFO: `/v3/projects/2a8598aad9b946e6b7235d9758da6782/users/c390fa37ec9344b1857acbd58fb3b0db/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:20.936576 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8598aad9b946e6b7235d9758da6782, user_id=c390fa37ec9344b1857acbd58fb3b0db, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:20.939530 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:20.953108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b2ba08700a48338b25f0054fa61acf', 'request_id': 'req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:20.959528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b2ba08700a48338b25f0054fa61acf', 'request_id': 'req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:20.967782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1005/2010] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:20 2022] PUT /identity/v3/projects/2a8598aad9b946e6b7235d9758da6782/users/c390fa37ec9344b1857acbd58fb3b0db/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:20.971786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.972707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b2ba08700a48338b25f0054fa61acf', 'request_id': 'req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:20.986703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] The token cache is being invalidate because project 98b2ba08700a48338b25f0054fa61acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:20.987026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:20.988216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:20.989980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1006/2011] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:20 2022] DELETE /identity/v3/projects/98b2ba08700a48338b25f0054fa61acf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:20.993826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:20.995443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:21.035795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:21.088626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87e62d-3834-40a7-81f7-ca93aed8cb01 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:21.094023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:21.094654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.094961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.095232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.095885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:21.097492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:21.108800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1006/2012] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:21.112885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:21.116408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:21.134276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba71235-d2fa-4bb4-b6c3-d03dc94c2ade admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:21.137620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7cf44-12ca-4f5a-a752-1b226594d875 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:21.140350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:21.141221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.141564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.141889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] PATH_INFO: `/v3/users/25e011b093544f79a00e69e67c7a35e0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.143537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e011b093544f79a00e69e67c7a35e0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:21.144116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe5fef-b455-4e6b-b46d-e8330aa755ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:21.145133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5fef-b455-4e6b-b46d-e8330aa755ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.145616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5fef-b455-4e6b-b46d-e8330aa755ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.145738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:21.146182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5fef-b455-4e6b-b46d-e8330aa755ab admin admin] PATH_INFO: `/v3/projects/2a8598aad9b946e6b7235d9758da6782/users/c390fa37ec9344b1857acbd58fb3b0db/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.148556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe5fef-b455-4e6b-b46d-e8330aa755ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8598aad9b946e6b7235d9758da6782, user_id=c390fa37ec9344b1857acbd58fb3b0db, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:21.151602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe5fef-b455-4e6b-b46d-e8330aa755ab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:21.168861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1007/2013] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:21 2022] PUT /identity/v3/projects/2a8598aad9b946e6b7235d9758da6782/users/c390fa37ec9344b1857acbd58fb3b0db/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:21.179829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.180200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.180557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.225810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e011b093544f79a00e69e67c7a35e0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.227153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] MFA Rules not processed for user `c390fa37ec9344b1857acbd58fb3b0db`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:21.232007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:21.240314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:21.240563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e011b093544f79a00e69e67c7a35e0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.243877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e011b093544f79a00e69e67c7a35e0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.246508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e011b093544f79a00e69e67c7a35e0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.256204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e011b093544f79a00e69e67c7a35e0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.277727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1007/2014] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:20 2022] DELETE /identity/v3/users/25e011b093544f79a00e69e67c7a35e0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:21.386912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1008/2015] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:21.393186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:21.394767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:21.400935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:21.402734 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:21.505846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dde4d-5e41-41a8-8909-638df64399ee None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:21.533836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a480d-1841-4142-91f3-8c72d2d264e9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:21.540947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:21.541922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.542343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.542737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] PATH_INFO: `/v3/projects/eb555c2a324a4b478538e5db2895ffb7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.544254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb555c2a324a4b478538e5db2895ffb7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:21.547751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:21.600340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d578aa-1ed2-4801-bb42-07b64e50135b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:21.601050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d578aa-1ed2-4801-bb42-07b64e50135b service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.605174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d578aa-1ed2-4801-bb42-07b64e50135b service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.605174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d578aa-1ed2-4801-bb42-07b64e50135b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.611822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:21.643049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb555c2a324a4b478538e5db2895ffb7', 'request_id': 'req-7776a4f7-1104-49f1-8049-5f99632f606f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.653067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb555c2a324a4b478538e5db2895ffb7', 'request_id': 'req-7776a4f7-1104-49f1-8049-5f99632f606f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.671607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb555c2a324a4b478538e5db2895ffb7', 'request_id': 'req-7776a4f7-1104-49f1-8049-5f99632f606f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.699464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] The token cache is being invalidate because project eb555c2a324a4b478538e5db2895ffb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:21.699835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.702527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7776a4f7-1104-49f1-8049-5f99632f606f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:21.705707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1008/2016] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:21 2022] DELETE /identity/v3/projects/eb555c2a324a4b478538e5db2895ffb7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:21.710804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ecb5c-acb9-4cd9-920d-6ddf163cfa16 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.712176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ecb5c-acb9-4cd9-920d-6ddf163cfa16 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.712449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ecb5c-acb9-4cd9-920d-6ddf163cfa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.775810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d84ecb5c-acb9-4cd9-920d-6ddf163cfa16 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:21.777053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d84ecb5c-acb9-4cd9-920d-6ddf163cfa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:21.823652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d578aa-1ed2-4801-bb42-07b64e50135b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:21.825221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d578aa-1ed2-4801-bb42-07b64e50135b service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:21.852762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1009/2017] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:21.935844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1009/2018] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:21.943741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e125ee-d93a-443a-9f96-05c62ec8e77c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:21.943978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e125ee-d93a-443a-9f96-05c62ec8e77c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:21.944255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e125ee-d93a-443a-9f96-05c62ec8e77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:21.981785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-31e125ee-d93a-443a-9f96-05c62ec8e77c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:21.983553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-31e125ee-d93a-443a-9f96-05c62ec8e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.009570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1010/2019] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:22.011997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ecb5c-acb9-4cd9-920d-6ddf163cfa16 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.036543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ecb5c-acb9-4cd9-920d-6ddf163cfa16 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.058681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.059427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.059710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.059983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.062186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:22.063622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.068395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.101895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1010/2020] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:31:22.106755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e125ee-d93a-443a-9f96-05c62ec8e77c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.118959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e125ee-d93a-443a-9f96-05c62ec8e77c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.122561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:22.142664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.143341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.143618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.143886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.144544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.148065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.163951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.165806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.200339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a8f9e-dd3f-45eb-bacc-989b3f3f7680 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.211705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.212377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.215951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.216250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] PATH_INFO: `/v3/users/dc2a6e5ac48449aa9bed24a61f6c9330` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.218929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2a6e5ac48449aa9bed24a61f6c9330)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.230875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.233827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1011/2021] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:22 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:22.238847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.347187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61b36-3fb6-46e1-b486-939b8315950b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.353354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2a6e5ac48449aa9bed24a61f6c9330'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.363655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.369057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.369433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.369842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.370942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.378860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.383418 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2a6e5ac48449aa9bed24a61f6c9330'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.384852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2a6e5ac48449aa9bed24a61f6c9330'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.385676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2a6e5ac48449aa9bed24a61f6c9330'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.400252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2a6e5ac48449aa9bed24a61f6c9330'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.423197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1012/2022] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:22 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:22.425263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.432735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.444085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1011/2023] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:22 2022] DELETE /identity/v3/users/dc2a6e5ac48449aa9bed24a61f6c9330 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:22.444986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.449348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.452597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3b906-1b2d-4a9f-a0e9-c693e36e3b94 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.479352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:22.558058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32819d3b-b493-423e-a4b5-d4f67229cca8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.566621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.567879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.568342 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.568781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] PATH_INFO: `/v3/projects/45a1f178dd9a4664a7247cc19f655889` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.571618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a1f178dd9a4664a7247cc19f655889)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.575855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.583567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59385246-bb9a-4952-b457-5797459b20ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.584266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385246-bb9a-4952-b457-5797459b20ff admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.584549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385246-bb9a-4952-b457-5797459b20ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.584819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385246-bb9a-4952-b457-5797459b20ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.585788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59385246-bb9a-4952-b457-5797459b20ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.590125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59385246-bb9a-4952-b457-5797459b20ff admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.625291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1013/2024] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:22.625291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b0d6-37f5-4884-a5bb-9df300b673ae None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.625291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b0d6-37f5-4884-a5bb-9df300b673ae None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.625291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b0d6-37f5-4884-a5bb-9df300b673ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.661272 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cb94b0d6-37f5-4884-a5bb-9df300b673ae None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:22.662406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cb94b0d6-37f5-4884-a5bb-9df300b673ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.671871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a1f178dd9a4664a7247cc19f655889', 'request_id': 'req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.687952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a1f178dd9a4664a7247cc19f655889', 'request_id': 'req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.711301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a1f178dd9a4664a7247cc19f655889', 'request_id': 'req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.726730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] The token cache is being invalidate because project 45a1f178dd9a4664a7247cc19f655889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:22.727049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.729684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:22.733434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1012/2025] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:22 2022] DELETE /identity/v3/projects/45a1f178dd9a4664a7247cc19f655889 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:22.738457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.739989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.755393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1014/2026] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:22.756871 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.757131 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.757711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.783637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:22.804599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:22.808192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.820397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1015/2027] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:22.821062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.829423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.854179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bc1cd-5a35-48bd-88af-1582b3c90cb4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.860654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71b1e7-b067-46c5-bca2-f64e13016365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.861282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71b1e7-b067-46c5-bca2-f64e13016365 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.861558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71b1e7-b067-46c5-bca2-f64e13016365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.861832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71b1e7-b067-46c5-bca2-f64e13016365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.862478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71b1e7-b067-46c5-bca2-f64e13016365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.864453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71b1e7-b067-46c5-bca2-f64e13016365 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.876705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1013/2028] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:22.881383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44a6b-4811-4fe0-9112-096bd3d62157 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.881680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44a6b-4811-4fe0-9112-096bd3d62157 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.881955 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44a6b-4811-4fe0-9112-096bd3d62157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.915598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d41ad2-4d86-4f3b-b68a-fbd62190fa73 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.915946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-40c44a6b-4811-4fe0-9112-096bd3d62157 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:22.917219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-40c44a6b-4811-4fe0-9112-096bd3d62157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:22.920111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.920989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.921331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.921759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.928614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1014/2029] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:22.929532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44a6b-4811-4fe0-9112-096bd3d62157 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.933807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.935389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.941019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44a6b-4811-4fe0-9112-096bd3d62157 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.945855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.946648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.946960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.947249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] PATH_INFO: `/v3/projects/ea429d2708124fb7a1709c29a727e31b/users/b665da5c72ae4114ba8b9345fce5a19b/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.948612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1016/2030] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:22.949634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:22.961451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f009c-898b-48a6-9875-84ca3aa030fb service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:22.971433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea429d2708124fb7a1709c29a727e31b, user_id=b665da5c72ae4114ba8b9345fce5a19b, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.973868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e207f8-e0ad-4324-bd82-7c0955d3e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:22.974499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e207f8-e0ad-4324-bd82-7c0955d3e6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:22.974785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e207f8-e0ad-4324-bd82-7c0955d3e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:22.977699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e207f8-e0ad-4324-bd82-7c0955d3e6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:22.979302 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e207f8-e0ad-4324-bd82-7c0955d3e6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:22.979646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e207f8-e0ad-4324-bd82-7c0955d3e6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:22.981054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:22.984769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e207f8-e0ad-4324-bd82-7c0955d3e6a7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.007866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1015/2031] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:22 2022] PUT /identity/v3/projects/ea429d2708124fb7a1709c29a727e31b/users/b665da5c72ae4114ba8b9345fce5a19b/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:23.012692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1017/2032] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:23.017220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.026577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cea83e-92fd-411a-9579-17827709f2e5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.027402 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cea83e-92fd-411a-9579-17827709f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.028551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cea83e-92fd-411a-9579-17827709f2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.043941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:23.073650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-88cea83e-92fd-411a-9579-17827709f2e5 None None] MFA Rules not processed for user `b665da5c72ae4114ba8b9345fce5a19b`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:23.075176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-88cea83e-92fd-411a-9579-17827709f2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:23.123139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7b877-2105-4ad9-a7ac-072459358a93 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.130340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.131032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.131568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.131849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.132496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.135099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.180884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1016/2033] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:23 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:23.184682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.196135 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1018/2034] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:23.201149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cea83e-92fd-411a-9579-17827709f2e5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.231204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cea83e-92fd-411a-9579-17827709f2e5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.310596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120971f4-00fd-4fe1-bd10-2c92df22bca4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.326553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.327979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.328274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.328539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.329315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.336510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.374534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1017/2035] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:23 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:23.379911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.387505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.402342 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8676ee-c0c1-46cd-8843-8e850f30964b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.408520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.408520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.408754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.409503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.419326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.431902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.435667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.437707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.438346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.440075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.441954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.486038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1019/2036] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:23 2022] POST /identity/v3/projects => generated 381 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:23.489813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.507160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:23.527008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1018/2037] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:23.531109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.556503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd804-7721-4216-9244-21fdde76978a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.633956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51953311-ff5f-49d8-a032-a3ba03f99f39 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.642564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.642564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.643504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.643812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.644531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.654352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.716789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1020/2038] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:23 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:23.733765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.776099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fc78-6da7-4d61-9276-b044c89761af admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.795973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.796647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.796918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.797187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.797974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.799884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.806079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.806775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.808673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.808953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.809625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.811878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.822251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1021/2039] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:23.826535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.837233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1019/2040] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:23.841126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124643-4c82-4931-9a5c-62b36f5deaca admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.843970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.850354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.851419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.851874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.852416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] PATH_INFO: `/v3/projects/2145a732dc4c49c084dd68230e442965/users/91c35060a9cd43c6823718ae3d99b409/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.869310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9610b5-3918-4a79-a339-63248cd62a73 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:23.878395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a07b8b-33f6-47a7-a2d1-f0a2e193fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:23.879517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07b8b-33f6-47a7-a2d1-f0a2e193fea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.879800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07b8b-33f6-47a7-a2d1-f0a2e193fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.881209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07b8b-33f6-47a7-a2d1-f0a2e193fea0 admin admin] PATH_INFO: `/v3/projects/e7ec5e2dbe34464b945d041cfbb7496e/users/6169e11761514ecda7d7ec6db9fd20f3/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:23.890336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2145a732dc4c49c084dd68230e442965, user_id=91c35060a9cd43c6823718ae3d99b409, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.895557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.896879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:23.918098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a07b8b-33f6-47a7-a2d1-f0a2e193fea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ec5e2dbe34464b945d041cfbb7496e, user_id=6169e11761514ecda7d7ec6db9fd20f3, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:23.922211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1022/2041] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:23 2022] PUT /identity/v3/projects/2145a732dc4c49c084dd68230e442965/users/91c35060a9cd43c6823718ae3d99b409/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:23.923328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a07b8b-33f6-47a7-a2d1-f0a2e193fea0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:23.924127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:23.955655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1020/2042] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:23 2022] PUT /identity/v3/projects/e7ec5e2dbe34464b945d041cfbb7496e/users/6169e11761514ecda7d7ec6db9fd20f3/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:23.969394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:23.969777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:23.970059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:24.037375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] MFA Rules not processed for user `6169e11761514ecda7d7ec6db9fd20f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:24.041067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:24.046945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb967-df76-4122-8788-038acc573f03 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:24.199493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1021/2043] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:24.200538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:24.210401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:24.238011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:24.238430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:24.238748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:24.239052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:24.239704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:24.241365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:24.254310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1023/2044] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:24.255234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:24.257718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:24.264291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:24.381942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66123685-4170-4f49-9d5d-0ebc467f2487 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:24.388254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:24.388991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:24.389340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:24.390358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] PATH_INFO: `/v3/projects/c944dce649554a638cea4f7058a9a332` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:24.403465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c944dce649554a638cea4f7058a9a332)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:24.409821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:24.435938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9434f8-3296-49b7-ae29-8c315001f53e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:24.442704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:24.457809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:24.459180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:24.459610 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:24.480436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:24.482338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:24.510466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1024/2045] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:24.512411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:24.520804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c944dce649554a638cea4f7058a9a332', 'request_id': 'req-979e7de8-5967-4eea-a382-bd529fb87495'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.532926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8e06c-f671-422f-9485-b8d4ed38c453 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:24.553047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c944dce649554a638cea4f7058a9a332', 'request_id': 'req-979e7de8-5967-4eea-a382-bd529fb87495'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.576275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c944dce649554a638cea4f7058a9a332', 'request_id': 'req-979e7de8-5967-4eea-a382-bd529fb87495'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.591223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] The token cache is being invalidate because project c944dce649554a638cea4f7058a9a332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:24.591743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.592625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.598417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1022/2046] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:24 2022] DELETE /identity/v3/projects/c944dce649554a638cea4f7058a9a332 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:24.600373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:24.602877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:24.620315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:24.697579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:24.698444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:24.698789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:24.699166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] PATH_INFO: `/v3/projects/2145a732dc4c49c084dd68230e442965/users/91c35060a9cd43c6823718ae3d99b409/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:24.701550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2145a732dc4c49c084dd68230e442965, user_id=91c35060a9cd43c6823718ae3d99b409, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:24.704662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:24.711216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7de8-5967-4eea-a382-bd529fb87495 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:24.723647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1025/2047] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:24 2022] PUT /identity/v3/projects/2145a732dc4c49c084dd68230e442965/users/91c35060a9cd43c6823718ae3d99b409/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:24.724804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:24.727158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:24.802572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:24.803267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:24.803547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:24.803810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] PATH_INFO: `/v3/users/6169e11761514ecda7d7ec6db9fd20f3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:24.805440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6169e11761514ecda7d7ec6db9fd20f3)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:24.807638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:24.845018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2aa1b-55b3-4ccc-af52-a47805f57ce9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:24.852305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:24.852863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:24.853144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:24.853770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] PATH_INFO: `/v3/users/c390fa37ec9344b1857acbd58fb3b0db` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:24.857203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c390fa37ec9344b1857acbd58fb3b0db)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:24.859409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:24.881897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6169e11761514ecda7d7ec6db9fd20f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.897784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6169e11761514ecda7d7ec6db9fd20f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.898545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6169e11761514ecda7d7ec6db9fd20f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.900037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6169e11761514ecda7d7ec6db9fd20f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.946774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f8f7a46e-91fc-4d4d-a70c-2858d6cf9eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6169e11761514ecda7d7ec6db9fd20f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.971224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:24.986155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c390fa37ec9344b1857acbd58fb3b0db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:24.994060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1023/2048] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:24 2022] DELETE /identity/v3/users/6169e11761514ecda7d7ec6db9fd20f3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:24.996032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:24.996591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:24.997045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.007884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c390fa37ec9344b1857acbd58fb3b0db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.022158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c390fa37ec9344b1857acbd58fb3b0db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.023085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c390fa37ec9344b1857acbd58fb3b0db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.023736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6eb52b58-bf64-4e61-a379-15f088312a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c390fa37ec9344b1857acbd58fb3b0db'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.036493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] MFA Rules not processed for user `91c35060a9cd43c6823718ae3d99b409`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:25.037736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.049435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1026/2049] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:24 2022] DELETE /identity/v3/users/c390fa37ec9344b1857acbd58fb3b0db => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:25.053897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.054251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.054592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.081103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:25.083195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.085238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:25.197540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1024/2050] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:25.198150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1027/2051] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:25.206638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.208667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.209799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.210928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.289674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6998c50-764a-4e1b-a691-a083f5bab4fb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:25.289999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea26638-b3e4-426c-a41f-8d61f560da7a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:25.294508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:25.296057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.296637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.297120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.341934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:25.342575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.342933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.343391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.374334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:25.376450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:25.383121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:25.385163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:25.390854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1025/2052] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:25.396227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1028/2053] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:25.458855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.460512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.479331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80c501-177c-44fe-a08f-5aac6b808b81 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:25.491562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.497144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:25.497965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.498307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.498674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] PATH_INFO: `/v3/projects/2a8598aad9b946e6b7235d9758da6782` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.500112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8598aad9b946e6b7235d9758da6782)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:25.502247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:25.504217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df8f09-049c-4728-823f-4725876e38e9 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:25.508679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95ccb-5b4e-4f02-962c-d7983fe3ab56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:25.510189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95ccb-5b4e-4f02-962c-d7983fe3ab56 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.510980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95ccb-5b4e-4f02-962c-d7983fe3ab56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.511636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95ccb-5b4e-4f02-962c-d7983fe3ab56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.514617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1ae95ccb-5b4e-4f02-962c-d7983fe3ab56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.528756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:25.573788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8598aad9b946e6b7235d9758da6782', 'request_id': 'req-8523ef5f-20b6-4d28-83b2-72014e526e69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.581788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8598aad9b946e6b7235d9758da6782', 'request_id': 'req-8523ef5f-20b6-4d28-83b2-72014e526e69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.593906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8598aad9b946e6b7235d9758da6782', 'request_id': 'req-8523ef5f-20b6-4d28-83b2-72014e526e69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.619450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] The token cache is being invalidate because project 2a8598aad9b946e6b7235d9758da6782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:25.619450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.619450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8523ef5f-20b6-4d28-83b2-72014e526e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.629670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1026/2054] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:25 2022] DELETE /identity/v3/projects/2a8598aad9b946e6b7235d9758da6782 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:25.631436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99602-fa5f-4c84-9a2a-03b059b11dd7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.631799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99602-fa5f-4c84-9a2a-03b059b11dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.632092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99602-fa5f-4c84-9a2a-03b059b11dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.648112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:25.656535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95ccb-5b4e-4f02-962c-d7983fe3ab56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:25.658325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95ccb-5b4e-4f02-962c-d7983fe3ab56 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:25.667837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c7a99602-fa5f-4c84-9a2a-03b059b11dd7 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:25.669553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1029/2055] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:25.669681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c7a99602-fa5f-4c84-9a2a-03b059b11dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.735520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1027/2056] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:25.744027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.744431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.744832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.767668 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:25.769219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.778647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1030/2057] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:25.783195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a99602-fa5f-4c84-9a2a-03b059b11dd7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.795084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a99602-fa5f-4c84-9a2a-03b059b11dd7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:25.800739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:25.801510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.801843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.802719 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.803544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:25.803921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:25.805963 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:25.822396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.823947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:25.829103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1028/2058] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:25.835494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.852242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2309-3ad3-4f52-b538-f637e62a3f10 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:25.856026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48cd4-5476-4d8c-a6a2-dd9356984067 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:25.862031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:25.862478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:25.862685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.863005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.863151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.863284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] PATH_INFO: `/v3/projects/e7ec5e2dbe34464b945d041cfbb7496e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.863407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.863641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:25.864962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ec5e2dbe34464b945d041cfbb7496e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:25.865703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:25.867717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:25.869917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:25.915238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1029/2059] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:25 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:25.919617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:25.928902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ec5e2dbe34464b945d041cfbb7496e', 'request_id': 'req-04c96cd1-12f3-4a1d-beff-d45c36a176ce'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.942669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ec5e2dbe34464b945d041cfbb7496e', 'request_id': 'req-04c96cd1-12f3-4a1d-beff-d45c36a176ce'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.952425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ec5e2dbe34464b945d041cfbb7496e', 'request_id': 'req-04c96cd1-12f3-4a1d-beff-d45c36a176ce'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.972683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] The token cache is being invalidate because project e7ec5e2dbe34464b945d041cfbb7496e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:25.973303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.979375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-04c96cd1-12f3-4a1d-beff-d45c36a176ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:25.981895 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1031/2060] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:25 2022] DELETE /identity/v3/projects/e7ec5e2dbe34464b945d041cfbb7496e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:25.987271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ba685-3c1d-4eeb-9cdd-a6b2989d2b48 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:25.987571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ba685-3c1d-4eeb-9cdd-a6b2989d2b48 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:25.988013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ba685-3c1d-4eeb-9cdd-a6b2989d2b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.014496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e63ba685-3c1d-4eeb-9cdd-a6b2989d2b48 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:26.014990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236ec86-52d1-40d7-973c-a4bc492215d5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.015776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e63ba685-3c1d-4eeb-9cdd-a6b2989d2b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.027124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.028095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.028537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.028807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.029454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.031546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.034793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1032/2061] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:26.043540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233760-6d38-4480-8fd2-606b184967fd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.044161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233760-6d38-4480-8fd2-606b184967fd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.044577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233760-6d38-4480-8fd2-606b184967fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.059677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1030/2062] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:25 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:26.063715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.065916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.069348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f6233760-6d38-4480-8fd2-606b184967fd None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:26.071280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f6233760-6d38-4480-8fd2-606b184967fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.085191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa8d0e-015d-46d8-b3a5-18950e3703f7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.085830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1033/2063] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:26.091024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233760-6d38-4480-8fd2-606b184967fd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.092619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.093586 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.094034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.094510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.095368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.098607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.102454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233760-6d38-4480-8fd2-606b184967fd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.113475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.113475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.113475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.113475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.114063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:26.114368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.116352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.118424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1031/2064] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:26.122535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.133480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3100-6771-4981-868a-f1a81ec34dea admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.138607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.138991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1034/2065] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:31:26.139457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.139732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.139995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.140641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.141747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.142251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.155475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1032/2066] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:26.156961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0df10-622b-45d9-ae38-e7ce07330a91 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.159930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.162170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.162790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.163100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.163371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.164019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.166093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.173270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9839d-28ef-4693-958d-5af837e79a59 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.178625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.179388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.179727 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.180064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] PATH_INFO: `/v3/projects/b912466c20084495ae7b7cfd26bdcdd5/users/ef84f1b4a27e4f70848ca39d3605ea8a/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.202309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b912466c20084495ae7b7cfd26bdcdd5, user_id=ef84f1b4a27e4f70848ca39d3605ea8a, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.205305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.217562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1035/2067] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:26.218579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.220358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.221948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1033/2068] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:26 2022] PUT /identity/v3/projects/b912466c20084495ae7b7cfd26bdcdd5/users/ef84f1b4a27e4f70848ca39d3605ea8a/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:26.231759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.238203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:26.281610 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:26.309674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc594f5-8650-4e8b-a11d-0579452b8e37 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.309906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127ffa2-e0fe-42ab-95c4-382f150e7af4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.314980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee096aa8-dbc0-4bd9-8228-ef894010da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.315325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.315601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee096aa8-dbc0-4bd9-8228-ef894010da49 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.315878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee096aa8-dbc0-4bd9-8228-ef894010da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.316146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee096aa8-dbc0-4bd9-8228-ef894010da49 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.316779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee096aa8-dbc0-4bd9-8228-ef894010da49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.318279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.318596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.318752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee096aa8-dbc0-4bd9-8228-ef894010da49 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.318943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] PATH_INFO: `/v3/users/b665da5c72ae4114ba8b9345fce5a19b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.320065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b665da5c72ae4114ba8b9345fce5a19b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.321965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.341124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1034/2069] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:26.342426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b41f80-4cd1-4f03-a695-70e765f514f2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.342715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b41f80-4cd1-4f03-a695-70e765f514f2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.343026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b41f80-4cd1-4f03-a695-70e765f514f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.376744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b4b41f80-4cd1-4f03-a695-70e765f514f2 None None] MFA Rules not processed for user `ef84f1b4a27e4f70848ca39d3605ea8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:26.378195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b4b41f80-4cd1-4f03-a695-70e765f514f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.389962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b665da5c72ae4114ba8b9345fce5a19b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:26.399981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b665da5c72ae4114ba8b9345fce5a19b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:26.413872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b665da5c72ae4114ba8b9345fce5a19b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:26.414672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b665da5c72ae4114ba8b9345fce5a19b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:26.415378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b665da5c72ae4114ba8b9345fce5a19b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:26.437526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1036/2070] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:26 2022] DELETE /identity/v3/users/b665da5c72ae4114ba8b9345fce5a19b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:26.438724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.440558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.471263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1035/2071] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:26.472433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181918-83ef-43f9-8ae8-58c5300ef1f2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.472619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181918-83ef-43f9-8ae8-58c5300ef1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.472895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181918-83ef-43f9-8ae8-58c5300ef1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.493783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-07181918-83ef-43f9-8ae8-58c5300ef1f2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:26.495129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-07181918-83ef-43f9-8ae8-58c5300ef1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.512894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306744a7-d04c-4661-9218-549316f04db4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.519105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.519727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.520021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.520344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.520958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.522646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.533663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1037/2072] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:26.534686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.536545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.550191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84763-0974-4a97-aee1-d412af7b8a56 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.555102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.555773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.556055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.556431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.567167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.567167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.574611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1036/2073] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:26.574611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07181918-83ef-43f9-8ae8-58c5300ef1f2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.588776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07181918-83ef-43f9-8ae8-58c5300ef1f2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.594629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.595011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.595289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.595558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.596305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1038/2074] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:26.597106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.598736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.599253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.601055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.612705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1037/2075] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:26.613591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.625238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3869b-181a-467a-b40a-d98442bddc9b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.635674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:26.643501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:26.670771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e94d-eec3-4a7d-a7e3-7faa99b418c2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.674778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bd733-6f7b-4d05-ad3d-d129bc58b9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.675486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd733-6f7b-4d05-ad3d-d129bc58b9db service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.675861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd733-6f7b-4d05-ad3d-d129bc58b9db service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.676202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd733-6f7b-4d05-ad3d-d129bc58b9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.685968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.686723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.688600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.688724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.689382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.691508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.720218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1038/2076] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:26.720857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.733691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687329e-0ee7-4cab-b792-0d59a77c4080 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.744209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.745135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.745504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.745867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] PATH_INFO: `/v3/projects/90f76af443a24fc0a529273866c6b1aa/users/19fd395925f34f7f8cf1bf6bbbb1239f/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.769018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f76af443a24fc0a529273866c6b1aa, user_id=19fd395925f34f7f8cf1bf6bbbb1239f, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.772177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.793623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bd733-6f7b-4d05-ad3d-d129bc58b9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.793623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bd733-6f7b-4d05-ad3d-d129bc58b9db service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.796435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1039/2077] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:26 2022] PUT /identity/v3/projects/90f76af443a24fc0a529273866c6b1aa/users/19fd395925f34f7f8cf1bf6bbbb1239f/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:26.800841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1039/2078] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:26.803874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.806412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.806894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.807098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.849897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] MFA Rules not processed for user `19fd395925f34f7f8cf1bf6bbbb1239f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:26.851160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.889130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4f5fb-4406-4980-ba37-2887b1fdaa9c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.895317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.895946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.896223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.896497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.897150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.899095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.910432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1040/2079] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:26.914703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.925971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af0e03-3973-4c6c-be50-f57939a9669e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.932561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.933276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.933583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.933906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.934564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.936338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:26.948976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1041/2080] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:26.954310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.966006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97183092-8300-4113-b0a6-1d8e31a03a29 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:26.967299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1040/2081] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:26.971766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444052c-d437-414a-891e-b648f9a2b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:26.972527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444052c-d437-414a-891e-b648f9a2b975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:26.972949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444052c-d437-414a-891e-b648f9a2b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:26.973900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444052c-d437-414a-891e-b648f9a2b975 admin admin] PATH_INFO: `/v3/projects/9bf26214e6424531a2b61b16d25a2e51/users/ef8da81870024df5ad8d0f6ed1674a62/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:26.984226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:26.986864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:26.995092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444052c-d437-414a-891e-b648f9a2b975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf26214e6424531a2b61b16d25a2e51, user_id=ef8da81870024df5ad8d0f6ed1674a62, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:26.998217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444052c-d437-414a-891e-b648f9a2b975 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.027830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1042/2082] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:26 2022] PUT /identity/v3/projects/9bf26214e6424531a2b61b16d25a2e51/users/ef8da81870024df5ad8d0f6ed1674a62/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:27.038689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.039009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.039270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.069511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495336-4995-478f-b628-2e27edeeed42 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.075952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] MFA Rules not processed for user `ef8da81870024df5ad8d0f6ed1674a62`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:27.077590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:27.094235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:27.117173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:27.140990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.141823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.142095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.142369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.160830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1043/2083] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:27.163863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.165295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:27.217602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.219384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.230722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1041/2084] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:27.231968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.235410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ed7c2-b9b8-4c1f-8337-c0a40ce7cdf5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.240649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.241246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.241520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.241790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] PATH_INFO: `/v3/projects/ea429d2708124fb7a1709c29a727e31b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.243007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea429d2708124fb7a1709c29a727e31b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.243998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60557d8e-9811-4bf3-90ea-49e76acc6bc2 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.245102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.249984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.250591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.250894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.251170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.252227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.254803 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.295002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1042/2085] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:27 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:27.299494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.307092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea429d2708124fb7a1709c29a727e31b', 'request_id': 'req-43cb65ee-08bb-46ec-83a9-074d9af16533'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.313996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea429d2708124fb7a1709c29a727e31b', 'request_id': 'req-43cb65ee-08bb-46ec-83a9-074d9af16533'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.324909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea429d2708124fb7a1709c29a727e31b', 'request_id': 'req-43cb65ee-08bb-46ec-83a9-074d9af16533'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.343023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] The token cache is being invalidate because project ea429d2708124fb7a1709c29a727e31b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:27.343343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.344087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.348679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1044/2086] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:27 2022] DELETE /identity/v3/projects/ea429d2708124fb7a1709c29a727e31b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:27.350625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.352555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:27.405345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414226-b243-472d-be96-fa98293d8793 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.411552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.412187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.412477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.412742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.413388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.415726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.443011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1043/2087] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:27 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:27.447372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.449384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:27.459367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb65ee-08bb-46ec-83a9-074d9af16533 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.464514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543e487-7305-42cc-a756-1d6b7e48a95b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.469947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.470179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.470914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.471205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.471531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.471634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.472054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.472203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] PATH_INFO: `/v3/users/91c35060a9cd43c6823718ae3d99b409` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.472303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.473907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.475195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c35060a9cd43c6823718ae3d99b409)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.478413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.487946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1044/2088] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:27.490393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:27.492633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.506162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59d4a2-4921-4652-9421-4d7ffd2b316b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.514582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.515963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.516944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.517235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] PATH_INFO: `/v3/projects/05e9c975ddf449cdb64b8482dfd09e02/users/17ec4257b1164f73a18e4475a83e1f7c/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.534057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e9c975ddf449cdb64b8482dfd09e02, user_id=17ec4257b1164f73a18e4475a83e1f7c, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.537098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.554031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1045/2089] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:27 2022] PUT /identity/v3/projects/05e9c975ddf449cdb64b8482dfd09e02/users/17ec4257b1164f73a18e4475a83e1f7c/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:27.558418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.561400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c35060a9cd43c6823718ae3d99b409'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.572576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c35060a9cd43c6823718ae3d99b409'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.574359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c35060a9cd43c6823718ae3d99b409'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.575624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:27.576252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c35060a9cd43c6823718ae3d99b409'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.586532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c35060a9cd43c6823718ae3d99b409'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:27.608528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1045/2090] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:27 2022] DELETE /identity/v3/users/91c35060a9cd43c6823718ae3d99b409 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:27.653728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f75a20-ca9b-4892-ad2b-8aa07fa143aa admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.744313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c87874-05d4-4905-aa00-ac59da56dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.744997 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c87874-05d4-4905-aa00-ac59da56dd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.745276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c87874-05d4-4905-aa00-ac59da56dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.745549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c87874-05d4-4905-aa00-ac59da56dd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.746735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c87874-05d4-4905-aa00-ac59da56dd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.748502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c87874-05d4-4905-aa00-ac59da56dd57 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.762870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1046/2091] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:27.766998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.768651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:27.782815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1dd3-ae72-4f2d-a6c7-555f3875672c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:27.788300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:27.788987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.789268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.789531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] PATH_INFO: `/v3/projects/05e9c975ddf449cdb64b8482dfd09e02/users/17ec4257b1164f73a18e4475a83e1f7c/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.792552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e9c975ddf449cdb64b8482dfd09e02, user_id=17ec4257b1164f73a18e4475a83e1f7c, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:27.801003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:27.826947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1046/2092] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:27 2022] PUT /identity/v3/projects/05e9c975ddf449cdb64b8482dfd09e02/users/17ec4257b1164f73a18e4475a83e1f7c/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:27.830749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:27.831144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:27.831526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:27.871162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] MFA Rules not processed for user `17ec4257b1164f73a18e4475a83e1f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:27.872611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:27.978781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1047/2093] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:27.990240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:27.993716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.040461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.042065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.101328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae81a5-8908-48c8-9930-5eb3af83ae45 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.106057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5765-7c74-4af9-abe2-b9c51abf2444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.106693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5765-7c74-4af9-abe2-b9c51abf2444 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.107023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5765-7c74-4af9-abe2-b9c51abf2444 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.107297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5765-7c74-4af9-abe2-b9c51abf2444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.109328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f09b5765-7c74-4af9-abe2-b9c51abf2444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.126389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:28.165800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e0312-b45c-4243-b59e-6776ad679c97 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.172507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.173248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.173599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.173976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] PATH_INFO: `/v3/projects/2145a732dc4c49c084dd68230e442965` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.175798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2145a732dc4c49c084dd68230e442965)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.178596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.215444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5765-7c74-4af9-abe2-b9c51abf2444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.217052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5765-7c74-4af9-abe2-b9c51abf2444 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.232497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1047/2094] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:28.252300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2145a732dc4c49c084dd68230e442965', 'request_id': 'req-4e3e3e40-fddd-42aa-a55d-863b865d20ab'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.264169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2145a732dc4c49c084dd68230e442965', 'request_id': 'req-4e3e3e40-fddd-42aa-a55d-863b865d20ab'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.271331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2145a732dc4c49c084dd68230e442965', 'request_id': 'req-4e3e3e40-fddd-42aa-a55d-863b865d20ab'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.287160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] The token cache is being invalidate because project 2145a732dc4c49c084dd68230e442965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:28.287622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.288417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.291333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1048/2095] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:28 2022] DELETE /identity/v3/projects/2145a732dc4c49c084dd68230e442965 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:28.296877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.297499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5eb1b-dcb3-4620-9ae9-754b5752c157 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.297795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5eb1b-dcb3-4620-9ae9-754b5752c157 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.298065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5eb1b-dcb3-4620-9ae9-754b5752c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.298551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.319610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8ac5eb1b-dcb3-4620-9ae9-754b5752c157 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:28.321350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8ac5eb1b-dcb3-4620-9ae9-754b5752c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.346210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:28.390465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e3e40-fddd-42aa-a55d-863b865d20ab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.399156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.399935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.400218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.400560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] PATH_INFO: `/v3/users/e20f32b26dfb46a78ebd13869e427cd1` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.402113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20f32b26dfb46a78ebd13869e427cd1)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.404171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1048/2096] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:28.411857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.414249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe913e-947d-4279-ae0a-1f98390b53b2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.414597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe913e-947d-4279-ae0a-1f98390b53b2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.414748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe913e-947d-4279-ae0a-1f98390b53b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.440101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1cbe913e-947d-4279-ae0a-1f98390b53b2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:28.441532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1cbe913e-947d-4279-ae0a-1f98390b53b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.450540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1049/2097] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:28.455094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe913e-947d-4279-ae0a-1f98390b53b2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.465291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe913e-947d-4279-ae0a-1f98390b53b2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.472850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.473461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.473929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.474249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.475017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:28.475561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.477327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.496717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1050/2098] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:28.497731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.498518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20f32b26dfb46a78ebd13869e427cd1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.509367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20f32b26dfb46a78ebd13869e427cd1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.510483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b897793-d43a-4ade-b412-870323ca9c74 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.518685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.519687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.520698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.521010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.521820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.523981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.529908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20f32b26dfb46a78ebd13869e427cd1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.531017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20f32b26dfb46a78ebd13869e427cd1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.532402 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0c626217-d155-459d-97fd-b775a302e1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20f32b26dfb46a78ebd13869e427cd1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:28.535234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:28.557313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1049/2099] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:28 2022] DELETE /identity/v3/users/e20f32b26dfb46a78ebd13869e427cd1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:28.561361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1051/2100] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:28 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:28.562543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.563290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.563721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.565577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.567588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.591764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:28.593053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.685023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6d1e6-2c52-4ff9-8b4a-479ebf80938c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.691761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.692469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.692840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.693176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.693924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.696583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1050/2101] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:28.698964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.707555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.709517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:28.728397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1052/2102] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:28 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:28.732706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.748266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ffb1-4bf7-4b2c-a6fc-f15cd5cece2a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.755681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.756311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.756587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.756903 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.757657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.760711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.779976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1053/2103] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:28.780508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68a1e-fac9-422c-a590-6ca93a9ae117 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.784490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.785215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.785560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.785901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.787608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.803615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077b3a-6cfe-432b-949b-869362f8bc86 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.808103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.809989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.810365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bdb97-ccc5-4936-9f67-560e89b6cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.812081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdb97-ccc5-4936-9f67-560e89b6cc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.812354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdb97-ccc5-4936-9f67-560e89b6cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.812623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdb97-ccc5-4936-9f67-560e89b6cc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.813280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bdb97-ccc5-4936-9f67-560e89b6cc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.814925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bdb97-ccc5-4936-9f67-560e89b6cc97 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.823460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1051/2104] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:28.848615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1054/2105] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:28.850262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:28.871203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de805980-3b8e-4408-bbcd-c257058cb9c6 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:28.886283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:28.887496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.888134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.889519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] PATH_INFO: `/v3/projects/3aee884907274128a417fa304ccc53f8/users/a0bc8a932bd74526b00643f0f0a93503/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.917344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aee884907274128a417fa304ccc53f8, user_id=a0bc8a932bd74526b00643f0f0a93503, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:28.921976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:28.955412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1052/2106] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:28 2022] PUT /identity/v3/projects/3aee884907274128a417fa304ccc53f8/users/a0bc8a932bd74526b00643f0f0a93503/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:28.957335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b550-dab0-4e48-bd05-c4892c791bd1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:28.957929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b550-dab0-4e48-bd05-c4892c791bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:28.958455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b550-dab0-4e48-bd05-c4892c791bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:28.997114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2c82b550-dab0-4e48-bd05-c4892c791bd1 None None] MFA Rules not processed for user `a0bc8a932bd74526b00643f0f0a93503`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:28.999122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2c82b550-dab0-4e48-bd05-c4892c791bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:29.066425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:29.113943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1055/2107] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:29.126412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:29.129064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:29.192861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b92f-e901-4621-8c53-8336dabc3524 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:29.196927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:29.197783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:29.198061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:29.198341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:29.207281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:29.208747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:29.218274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1053/2108] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:29.247145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82b550-dab0-4e48-bd05-c4892c791bd1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:29.316217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82b550-dab0-4e48-bd05-c4892c791bd1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:29.321146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:29.321850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:29.322127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:29.322432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] PATH_INFO: `/v3/users/a0bc8a932bd74526b00643f0f0a93503` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:29.323726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bc8a932bd74526b00643f0f0a93503)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:29.325661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:29.378489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bc8a932bd74526b00643f0f0a93503'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.391368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bc8a932bd74526b00643f0f0a93503'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.392003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bc8a932bd74526b00643f0f0a93503'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.394743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bc8a932bd74526b00643f0f0a93503'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.415155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4b580911-ef2d-4e0d-ae58-7f96c1321252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bc8a932bd74526b00643f0f0a93503'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.416720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:29.421080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:29.441136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb668f-2fab-4c78-a278-ff8ca06200cb service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:29.448447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:29.449738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:29.450560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:29.452391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] PATH_INFO: `/v3/projects/9fc26a3fc2bb477d8f479faa7acc4669` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:29.455382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc26a3fc2bb477d8f479faa7acc4669)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:29.458214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:29.460126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1056/2109] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:29 2022] DELETE /identity/v3/users/a0bc8a932bd74526b00643f0f0a93503 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:29.468460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:29.468746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:29.469013 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:29.477948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:29.501851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:29.504273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:29.538735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc26a3fc2bb477d8f479faa7acc4669', 'request_id': 'req-477a7c99-336c-472a-864c-51ed7d2b6777'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.558141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc26a3fc2bb477d8f479faa7acc4669', 'request_id': 'req-477a7c99-336c-472a-864c-51ed7d2b6777'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.570760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc26a3fc2bb477d8f479faa7acc4669', 'request_id': 'req-477a7c99-336c-472a-864c-51ed7d2b6777'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.582878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1057/2110] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:29.590392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] The token cache is being invalidate because project 9fc26a3fc2bb477d8f479faa7acc4669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:29.590800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.591537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.593790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1054/2111] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:29 2022] DELETE /identity/v3/projects/9fc26a3fc2bb477d8f479faa7acc4669 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:29.594135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:29.595989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:29.599075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:29.601828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:29.602677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:29.677642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998052a-7d68-4f1d-86fa-237feb57867b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:29.702636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a7c99-336c-472a-864c-51ed7d2b6777 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:29.708443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:29.709436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:29.711476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:29.712122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] PATH_INFO: `/v3/users/d9105698b8134138a7393c8d9688414b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:29.713525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9105698b8134138a7393c8d9688414b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:29.716248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:29.740713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:29.741346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:29.741815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:29.742090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:29.744026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:29.759569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:29.761477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:29.772663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1058/2112] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:29.827865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9105698b8134138a7393c8d9688414b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.843014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9105698b8134138a7393c8d9688414b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.868490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9105698b8134138a7393c8d9688414b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.870930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9105698b8134138a7393c8d9688414b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.879141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9105698b8134138a7393c8d9688414b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:29.902155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1055/2113] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:29 2022] DELETE /identity/v3/users/d9105698b8134138a7393c8d9688414b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:30.014491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:30.016020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.103452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da474-c96e-4840-8460-0ae188893966 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:30.174175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:30.174612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.174970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.175256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.177613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.233617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:30.273931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:30.275700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:30.309154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1059/2114] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:30.405165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:30.406768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.428797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:30.431161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.434107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:30.579994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0b0b0-c8c0-47e8-baf6-d7c822374402 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:30.589588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:30.590256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.590522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.592422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] PATH_INFO: `/v3/projects/3aee884907274128a417fa304ccc53f8` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.594948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aee884907274128a417fa304ccc53f8)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:30.599376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:30.608614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a0a02-01fd-436c-9992-df1c34c699b8 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:30.617290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:30.618293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.618999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.619504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] PATH_INFO: `/v3/projects/cbd02e6ac8ea4515ae570c09da065102` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.621612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd02e6ac8ea4515ae570c09da065102)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:30.626677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:30.692810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aee884907274128a417fa304ccc53f8', 'request_id': 'req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.704698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aee884907274128a417fa304ccc53f8', 'request_id': 'req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.714924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aee884907274128a417fa304ccc53f8', 'request_id': 'req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.730215 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd02e6ac8ea4515ae570c09da065102', 'request_id': 'req-2944ece0-e753-49f4-af9d-d0cb96902b70'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.730918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] The token cache is being invalidate because project 3aee884907274128a417fa304ccc53f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:30.731219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.732031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-234ba2ec-c751-44ae-bc28-ab1f4f421aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.734123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1056/2115] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:30 2022] DELETE /identity/v3/projects/3aee884907274128a417fa304ccc53f8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:30.738661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74ad62-6c3c-4c11-9c8a-68dc72c33238 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.739930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74ad62-6c3c-4c11-9c8a-68dc72c33238 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.740689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74ad62-6c3c-4c11-9c8a-68dc72c33238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.741885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd02e6ac8ea4515ae570c09da065102', 'request_id': 'req-2944ece0-e753-49f4-af9d-d0cb96902b70'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.760863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd02e6ac8ea4515ae570c09da065102', 'request_id': 'req-2944ece0-e753-49f4-af9d-d0cb96902b70'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.768900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ac74ad62-6c3c-4c11-9c8a-68dc72c33238 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:30.782576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] The token cache is being invalidate because project cbd02e6ac8ea4515ae570c09da065102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:30.783471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.783628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ac74ad62-6c3c-4c11-9c8a-68dc72c33238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.785222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2944ece0-e753-49f4-af9d-d0cb96902b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:30.789218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1060/2116] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:30 2022] DELETE /identity/v3/projects/cbd02e6ac8ea4515ae570c09da065102 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:30.796673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f824a6-78f7-4e45-b9a4-38a4ccb0a4f9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.797124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f824a6-78f7-4e45-b9a4-38a4ccb0a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.797629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f824a6-78f7-4e45-b9a4-38a4ccb0a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.822940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e6f824a6-78f7-4e45-b9a4-38a4ccb0a4f9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:30.824353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e6f824a6-78f7-4e45-b9a4-38a4ccb0a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.900394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1057/2117] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:30.902711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1061/2118] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:30.908790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e860d3-4a35-4dcd-ac73-186860c69f2b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.909079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e860d3-4a35-4dcd-ac73-186860c69f2b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.910838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ba44-adbf-4a33-b5eb-502fa3614c45 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.911134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ba44-adbf-4a33-b5eb-502fa3614c45 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.911407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ba44-adbf-4a33-b5eb-502fa3614c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.912606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e860d3-4a35-4dcd-ac73-186860c69f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.926433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:30.936208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-18e860d3-4a35-4dcd-ac73-186860c69f2b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:30.937735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-18e860d3-4a35-4dcd-ac73-186860c69f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.946322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0e83ba44-adbf-4a33-b5eb-502fa3614c45 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:30.948839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0e83ba44-adbf-4a33-b5eb-502fa3614c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:30.952255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1058/2119] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:30.953164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e860d3-4a35-4dcd-ac73-186860c69f2b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:30.963424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e860d3-4a35-4dcd-ac73-186860c69f2b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:30.966112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1062/2120] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:30.967405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ba44-adbf-4a33-b5eb-502fa3614c45 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:30.969025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:30.969891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.970379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.971146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.972014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:30.972519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:30.974785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:30.980653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ba44-adbf-4a33-b5eb-502fa3614c45 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:30.988644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:30.989272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:30.989552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:30.989830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:30.990530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:30.990855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:30.992707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:30.995744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1059/2121] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:30.996640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.011615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1063/2122] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:31.015714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f54bd-2541-4b20-aa44-b1dc37c0f3de admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.022533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.023219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.023511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.023781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.024425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.026615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.028186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.042594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47610e41-6977-46d3-b79b-39a5edb9bb49 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.052935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.054461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.054804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.055193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.055990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.059775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.073206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1060/2123] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:30 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:31.084017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.084017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:31.115497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1064/2124] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:31 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:31.116921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.200290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef702850-4ecf-428e-b2a2-b56c8fe54c66 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.216100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445928d9-50e7-4db2-8d64-331a51fcdbf4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.220763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.221127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.222096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.222209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.222285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.222285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.222427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.222427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.222731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.224665 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.225608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.229155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.254540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1065/2125] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:31 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:31.255304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.256996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:31.273256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1061/2126] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:31 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:31.274513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.287045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168986e4-1a30-4769-84ba-c429c6562085 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.293147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.293782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.294062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.294334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.295028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.296707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.308291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1062/2127] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:31.309148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.320164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d048fe8-b809-4649-a7a3-dbaa5da2d4d8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.329820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.330520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.331009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.331117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.332006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.333682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.353993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5590-ed7f-45de-a5aa-1f9afac31e30 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.360854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1063/2128] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:31.361581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.361894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.362041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.362041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.362041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.362041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:31.375177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad02-b318-4748-8ad4-2cd31fd472bd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.380641 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.381274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.381543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.381812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.382601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.384268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.397013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1064/2129] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:31.397967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.411319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218a6c-4065-44fd-bbe8-1b5ff791be9c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.419819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.421074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.421074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.421074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.433747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.439387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.465782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1065/2130] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:31.470212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.504228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6146cd-686b-405a-9962-bfd210ea7d56 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.516324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ce31-9e6c-4f41-9092-e9b27931fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.517359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ce31-9e6c-4f41-9092-e9b27931fe17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.518929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ce31-9e6c-4f41-9092-e9b27931fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.518929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ce31-9e6c-4f41-9092-e9b27931fe17 admin admin] PATH_INFO: `/v3/projects/27f3c52fa0f54552a222d7fb0f010e1a/users/14bdbb163d8043f0bbcee01f0f15e145/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.521519 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.523141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.536471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:31.552157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1066/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:31.555412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.557585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ce31-9e6c-4f41-9092-e9b27931fe17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f3c52fa0f54552a222d7fb0f010e1a, user_id=14bdbb163d8043f0bbcee01f0f15e145, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.569856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42f320-9902-4143-81f4-0564adccffba service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.575608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45169421-8c40-4da6-9a82-43d1a4c13742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.576434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169421-8c40-4da6-9a82-43d1a4c13742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.576943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169421-8c40-4da6-9a82-43d1a4c13742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.577222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169421-8c40-4da6-9a82-43d1a4c13742 admin admin] PATH_INFO: `/v3/projects/cd74c61af5e64661b1c2004e36806148/users/ac8270c824de4344b6ad11acb48f6a6e/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.579157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ce31-9e6c-4f41-9092-e9b27931fe17 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.597896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45169421-8c40-4da6-9a82-43d1a4c13742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd74c61af5e64661b1c2004e36806148, user_id=ac8270c824de4344b6ad11acb48f6a6e, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.601081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45169421-8c40-4da6-9a82-43d1a4c13742 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.634612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1066/2132] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:31 2022] PUT /identity/v3/projects/27f3c52fa0f54552a222d7fb0f010e1a/users/14bdbb163d8043f0bbcee01f0f15e145/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:31.650497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9ea6f-6314-47c4-8477-c61d2bc8db70 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.651127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9ea6f-6314-47c4-8477-c61d2bc8db70 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.651419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9ea6f-6314-47c4-8477-c61d2bc8db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.661882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1067/2133] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:31 2022] PUT /identity/v3/projects/cd74c61af5e64661b1c2004e36806148/users/ac8270c824de4344b6ad11acb48f6a6e/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:31.670172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.670728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.670997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.718628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:31.722232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:31.731491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-79e9ea6f-6314-47c4-8477-c61d2bc8db70 None None] MFA Rules not processed for user `14bdbb163d8043f0bbcee01f0f15e145`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:31.732731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-79e9ea6f-6314-47c4-8477-c61d2bc8db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:31.855284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1068/2134] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:31.861737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.863527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:31.870097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1067/2135] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:31.875007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9ea6f-6314-47c4-8477-c61d2bc8db70 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:31.888824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9ea6f-6314-47c4-8477-c61d2bc8db70 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.896165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:31.897185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:31.897778 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:31.898766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:31.899726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:31.902209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:31.919733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:31.954168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1068/2136] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:31 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:31.955046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c245c55-bcf8-4594-be50-c5a6f2aaed57 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:31.955766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.060857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.061656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.062095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.062504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.091579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983f71-06b3-4e7a-a066-793c20f874e4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.092133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.094694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.094694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.094694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.095011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.095611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.097751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.098142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.111217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1069/2137] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:32.128206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1069/2138] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:31 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:32.132682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.145664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b8e32-bb14-4afd-9f41-d7299e4b40eb service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.162777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.166358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:32.168822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.170104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.170712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.171197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.171992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.173744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.184967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1070/2139] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:32.186709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ab5b-b489-4ba0-8663-c85b842faf35 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.189298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.194622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.195460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.195794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.196178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] PATH_INFO: `/v3/users/92087877ad074bee9655c1a55fb5ba71` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.197551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92087877ad074bee9655c1a55fb5ba71)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.199889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.200295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620ffe-fa9a-465e-9e9c-35a7c40fd043 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.205948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.206649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.206985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.207304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] PATH_INFO: `/v3/projects/589f9821b0e542a4bd85b895683aaccd/users/05c092fe4bcb49c3b19b7d1912a112b6/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.224110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589f9821b0e542a4bd85b895683aaccd, user_id=05c092fe4bcb49c3b19b7d1912a112b6, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.227648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.239561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:32.248457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1071/2140] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:32 2022] PUT /identity/v3/projects/589f9821b0e542a4bd85b895683aaccd/users/05c092fe4bcb49c3b19b7d1912a112b6/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:32.249841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.261831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92087877ad074bee9655c1a55fb5ba71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:32.272533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92087877ad074bee9655c1a55fb5ba71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:32.290565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92087877ad074bee9655c1a55fb5ba71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:32.291361 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92087877ad074bee9655c1a55fb5ba71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:32.291993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92087877ad074bee9655c1a55fb5ba71'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:32.312446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1070/2141] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:32 2022] DELETE /identity/v3/users/92087877ad074bee9655c1a55fb5ba71 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:32.330731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5b727-c6dd-4e98-aef0-9edf22952ea8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.402846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f042a0a-7b9e-4784-b2d1-3be82c07a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.403480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042a0a-7b9e-4784-b2d1-3be82c07a137 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.403750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042a0a-7b9e-4784-b2d1-3be82c07a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.404038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042a0a-7b9e-4784-b2d1-3be82c07a137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.404681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f042a0a-7b9e-4784-b2d1-3be82c07a137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.406476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f042a0a-7b9e-4784-b2d1-3be82c07a137 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.417067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1072/2142] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:32.421779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.423352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:32.437948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16143c1-7412-4dc6-a0b3-5c216cb28023 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.443429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.444123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.444397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.444675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] PATH_INFO: `/v3/projects/589f9821b0e542a4bd85b895683aaccd/users/05c092fe4bcb49c3b19b7d1912a112b6/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.447451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589f9821b0e542a4bd85b895683aaccd, user_id=05c092fe4bcb49c3b19b7d1912a112b6, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.450036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.461708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1071/2143] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:32 2022] PUT /identity/v3/projects/589f9821b0e542a4bd85b895683aaccd/users/05c092fe4bcb49c3b19b7d1912a112b6/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:32.472907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.473278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.473546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.505555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] MFA Rules not processed for user `05c092fe4bcb49c3b19b7d1912a112b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:32.506692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:32.583382 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1073/2144] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:32.595125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.596835 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:32.649556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:32.665688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90743223-0672-46ff-b064-27109edaa183 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.670114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e65e29-e83c-4c3f-91ae-4bca2c68388a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.671056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e65e29-e83c-4c3f-91ae-4bca2c68388a service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.671184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e65e29-e83c-4c3f-91ae-4bca2c68388a service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.671412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e65e29-e83c-4c3f-91ae-4bca2c68388a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.673401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-36e65e29-e83c-4c3f-91ae-4bca2c68388a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:32.739579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e65e29-e83c-4c3f-91ae-4bca2c68388a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.741480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e65e29-e83c-4c3f-91ae-4bca2c68388a service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:32.756253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1072/2145] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:32.860650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:32.862231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:32.936807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:32.977879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64617e-58c3-41e5-bcfc-2639a7d936b9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:32.983534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:32.984352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:32.984758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:32.985163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] PATH_INFO: `/v3/projects/0da7d88a12e6416b88afbe2753942190` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:32.986377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da7d88a12e6416b88afbe2753942190)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:32.988646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:33.067762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da7d88a12e6416b88afbe2753942190', 'request_id': 'req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:33.081218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da7d88a12e6416b88afbe2753942190', 'request_id': 'req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:33.094400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da7d88a12e6416b88afbe2753942190', 'request_id': 'req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:33.134784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] The token cache is being invalidate because project 0da7d88a12e6416b88afbe2753942190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:33.135192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:33.135863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-94c6b6f7-a930-4f6e-98ba-09d5a7dd6da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:33.152659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1074/2146] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:32 2022] DELETE /identity/v3/projects/0da7d88a12e6416b88afbe2753942190 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:33.157865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8ce1-e638-4f1f-a0a9-14d16ee069ca None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.158388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8ce1-e638-4f1f-a0a9-14d16ee069ca None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.158983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8ce1-e638-4f1f-a0a9-14d16ee069ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.210263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-30ea8ce1-e638-4f1f-a0a9-14d16ee069ca None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:33.211548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-30ea8ce1-e638-4f1f-a0a9-14d16ee069ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:33.370967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1073/2147] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:33.372244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdc284-f87b-45e6-860a-4de2ddda0870 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.372723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdc284-f87b-45e6-860a-4de2ddda0870 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.373097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdc284-f87b-45e6-860a-4de2ddda0870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.413267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-47bdc284-f87b-45e6-860a-4de2ddda0870 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:33.414901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-47bdc284-f87b-45e6-860a-4de2ddda0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:33.427854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1075/2148] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:33.429071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8ce1-e638-4f1f-a0a9-14d16ee069ca None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:33.441411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8ce1-e638-4f1f-a0a9-14d16ee069ca None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:33.462036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:33.462889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.463365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.463918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.465116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:33.465791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:33.467985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:33.487975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1074/2149] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:33.489837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdc284-f87b-45e6-860a-4de2ddda0870 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:33.503425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdc284-f87b-45e6-860a-4de2ddda0870 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:33.515046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:33.518179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.518588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.519003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.519731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:33.522957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:33.590927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1076/2150] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:33 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:33.593027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:33.609002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a26d-860d-4309-b7e7-5fd2170b80a1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:33.737157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:33.737792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.738072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.738344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.739163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:33.741160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:33.765414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1075/2151] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:33 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:33.769681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:33.780154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb2d8-92a0-4d99-b450-eaa566141c29 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:33.786080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:33.786704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.787028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.787765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.787975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:33.789580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:33.800039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1077/2152] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:33.805258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:33.818433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af534d72-2314-4950-acaa-144f8681cdc7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:33.827532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57a25-edc3-4f06-88a2-ac324ccf0240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:33.828279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57a25-edc3-4f06-88a2-ac324ccf0240 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.828561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57a25-edc3-4f06-88a2-ac324ccf0240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.828832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57a25-edc3-4f06-88a2-ac324ccf0240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.829500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57a25-edc3-4f06-88a2-ac324ccf0240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:33.831137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57a25-edc3-4f06-88a2-ac324ccf0240 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:33.836922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:33.848508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1076/2153] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:33.850450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:33.861100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb582b-0ad3-4f39-85aa-92df2ad3c547 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:33.866007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:33.866794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.867102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.867378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] PATH_INFO: `/v3/projects/34235215e16247ed9960c9c3fcebd483/users/7cd94aab61a24798bb68b6aaa24c767c/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.886905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=34235215e16247ed9960c9c3fcebd483, user_id=7cd94aab61a24798bb68b6aaa24c767c, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:33.890222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:33.913886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1078/2154] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:33 2022] PUT /identity/v3/projects/34235215e16247ed9960c9c3fcebd483/users/7cd94aab61a24798bb68b6aaa24c767c/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:33.924435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0ce9-a3bc-4525-bf5d-ff8e40af1b30 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:33.924724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0ce9-a3bc-4525-bf5d-ff8e40af1b30 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:33.926083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0ce9-a3bc-4525-bf5d-ff8e40af1b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:33.958098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-247e0ce9-a3bc-4525-bf5d-ff8e40af1b30 None None] MFA Rules not processed for user `7cd94aab61a24798bb68b6aaa24c767c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:33.959348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-247e0ce9-a3bc-4525-bf5d-ff8e40af1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:34.046084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1077/2155] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:34.050972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:34.126353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:34.134542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c98b6-3bed-4247-9e29-68db0db2f0fe admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:34.140530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:34.142016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.142411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.142684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:34.143273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:34.145205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:34.180290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1079/2156] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:34.185064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e0ce9-a3bc-4525-bf5d-ff8e40af1b30 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:34.197149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e0ce9-a3bc-4525-bf5d-ff8e40af1b30 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:34.264264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:34.264264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.264264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.264264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:34.264686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:34.266882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:34.294415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1078/2157] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:34 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:34.299072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:34.316841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6d262-eb86-4212-88d7-af52e92bcaf4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:34.321715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:34.322447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.322731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.323058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:34.323688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:34.325348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:34.337262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1080/2158] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:34.341994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:34.352472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971c2d9-c7f1-4236-bfb9-0d5c06fc9636 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:34.357553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:34.358409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.358690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.359080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] PATH_INFO: `/v3/projects/8e9daa2b795a45d192e3cc7028499d4b/users/1802ebe3f66d4b81a969a434d07cc1aa/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:34.377508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9daa2b795a45d192e3cc7028499d4b, user_id=1802ebe3f66d4b81a969a434d07cc1aa, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:34.380445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:34.401849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1079/2159] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:34 2022] PUT /identity/v3/projects/8e9daa2b795a45d192e3cc7028499d4b/users/1802ebe3f66d4b81a969a434d07cc1aa/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:34.403668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:34.439084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa0920-4d54-41eb-8881-f459d978349e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:34.564666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2df17-ab56-4b5d-9d03-6d32c79f46ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:34.565341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2df17-ab56-4b5d-9d03-6d32c79f46ab admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.565625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2df17-ab56-4b5d-9d03-6d32c79f46ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.565901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2df17-ab56-4b5d-9d03-6d32c79f46ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:34.566563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2df17-ab56-4b5d-9d03-6d32c79f46ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:34.568233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2df17-ab56-4b5d-9d03-6d32c79f46ab admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:34.594332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1081/2160] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:34.598224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:34.615530 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3919f3-3c7b-44ae-8036-02a3e57bfce8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:34.628997 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:34.629699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.629976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.630244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] PATH_INFO: `/v3/projects/8e9daa2b795a45d192e3cc7028499d4b/users/1802ebe3f66d4b81a969a434d07cc1aa/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:34.633777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9daa2b795a45d192e3cc7028499d4b, user_id=1802ebe3f66d4b81a969a434d07cc1aa, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:34.636234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:34.649011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1080/2161] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:34 2022] PUT /identity/v3/projects/8e9daa2b795a45d192e3cc7028499d4b/users/1802ebe3f66d4b81a969a434d07cc1aa/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:34.661820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6e48-c87f-4a01-97c1-22da33284d3b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.661820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6e48-c87f-4a01-97c1-22da33284d3b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.662078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6e48-c87f-4a01-97c1-22da33284d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:34.695725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-27fb6e48-c87f-4a01-97c1-22da33284d3b None None] MFA Rules not processed for user `1802ebe3f66d4b81a969a434d07cc1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:34.711804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-27fb6e48-c87f-4a01-97c1-22da33284d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:34.847886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1082/2162] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:34.895968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:34.898548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:34.964603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:34.981961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86a02-e50c-40b3-840c-9ec41fd46362 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:34.991832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:34.992985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:34.993508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:34.994370 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:35.008705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:35.010717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:35.031432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1081/2163] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:35.152140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6e48-c87f-4a01-97c1-22da33284d3b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:35.165171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6e48-c87f-4a01-97c1-22da33284d3b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:35.170041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:35.170992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:35.171479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:35.172158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:35.245293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:35.263242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:35.266010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:35.293103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1083/2164] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:35.837030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:35.839656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:35.858237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f335-2cb0-4ee6-a982-fccbf028d518 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:35.864331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824ffd-62fe-42f6-bb5a-70842480307b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:35.865222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824ffd-62fe-42f6-bb5a-70842480307b service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:35.865628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824ffd-62fe-42f6-bb5a-70842480307b service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:35.866019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824ffd-62fe-42f6-bb5a-70842480307b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:35.868696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-91824ffd-62fe-42f6-bb5a-70842480307b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:35.963110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824ffd-62fe-42f6-bb5a-70842480307b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:35.965727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824ffd-62fe-42f6-bb5a-70842480307b service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:35.979653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1082/2165] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:36.551750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:36.554105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:36.737158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647efc5-254e-4e54-a79b-330535f07d6e service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:36.749569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:36.750306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:36.750582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:36.750871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] PATH_INFO: `/v3/users/ef84f1b4a27e4f70848ca39d3605ea8a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:36.752113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef84f1b4a27e4f70848ca39d3605ea8a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:36.753985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:36.870787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef84f1b4a27e4f70848ca39d3605ea8a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:36.886167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef84f1b4a27e4f70848ca39d3605ea8a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:36.887260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef84f1b4a27e4f70848ca39d3605ea8a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:36.888085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef84f1b4a27e4f70848ca39d3605ea8a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:36.913078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef84f1b4a27e4f70848ca39d3605ea8a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:36.960836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1084/2166] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:36 2022] DELETE /identity/v3/users/ef84f1b4a27e4f70848ca39d3605ea8a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:36.963555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe53f-79d7-4273-86cb-3114d53cee82 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:36.964422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe53f-79d7-4273-86cb-3114d53cee82 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:36.964504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe53f-79d7-4273-86cb-3114d53cee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:37.002542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-dcefe53f-79d7-4273-86cb-3114d53cee82 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:37.003880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dcefe53f-79d7-4273-86cb-3114d53cee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:37.119857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1083/2167] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:37.128549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:37.132181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:37.251079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb09512-4541-4e0c-8ae4-037aae653c98 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:37.256969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:37.257609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:37.257898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:37.258149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:37.272194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:37.275832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:37.300700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1085/2168] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:37.982583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:37.983271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:37.983271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.031326 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] MFA Rules not processed for user `ac8270c824de4344b6ad11acb48f6a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:38.033430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:38.047079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.051607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:38.076110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1048a0-3503-4b51-a574-39274efe33ee service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.091265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.092290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.095695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.096085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] PATH_INFO: `/v3/projects/b912466c20084495ae7b7cfd26bdcdd5` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.097935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b912466c20084495ae7b7cfd26bdcdd5)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.111521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.111521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:38.153067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1084/2169] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:38.157239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.158747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:38.169205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b912466c20084495ae7b7cfd26bdcdd5', 'request_id': 'req-07e81ca6-ca77-4d27-a702-66d87ea3888b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.172808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd259-29ae-4483-b4ca-7c05a3df081c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.176609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b912466c20084495ae7b7cfd26bdcdd5', 'request_id': 'req-07e81ca6-ca77-4d27-a702-66d87ea3888b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.178745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:38.188482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b912466c20084495ae7b7cfd26bdcdd5', 'request_id': 'req-07e81ca6-ca77-4d27-a702-66d87ea3888b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.202485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] The token cache is being invalidate because project b912466c20084495ae7b7cfd26bdcdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:38.202777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.203487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.205007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1086/2170] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:38 2022] DELETE /identity/v3/projects/b912466c20084495ae7b7cfd26bdcdd5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:38.209135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.211327 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:38.240850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.241552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.241956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.242267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.243195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.246067 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.282034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1085/2171] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:38 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:38.287932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.289773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:38.304801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e81ca6-ca77-4d27-a702-66d87ea3888b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.369802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13755-d610-4e95-a916-1dbf6c413350 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.375516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.376172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.376448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.376716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.377364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.379363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.379561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.380194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.380477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.380760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] PATH_INFO: `/v3/users/ef8da81870024df5ad8d0f6ed1674a62` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.381988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8da81870024df5ad8d0f6ed1674a62)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.383987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.410036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1086/2172] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:38 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:38.411921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.425879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4ed5c-4388-4ab0-b31c-f7f9f3490dbb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.432187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.432814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.433095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.433476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.434466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.436195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.450205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:38.453972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8da81870024df5ad8d0f6ed1674a62'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.459824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1087/2173] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:38.461281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.467725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8da81870024df5ad8d0f6ed1674a62'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.468818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8da81870024df5ad8d0f6ed1674a62'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.471150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8da81870024df5ad8d0f6ed1674a62'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.474555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ce09-5024-4b94-bfb9-f7f76c68fe6d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.480068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.481359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.481472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.481888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] PATH_INFO: `/v3/projects/543865c55cf746c588995ee150a46262/users/2a1fb1b3897146128e8c85806d95f62f/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.484409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8da81870024df5ad8d0f6ed1674a62'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:38.502324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543865c55cf746c588995ee150a46262, user_id=2a1fb1b3897146128e8c85806d95f62f, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.507130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.514255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1087/2174] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:38 2022] DELETE /identity/v3/users/ef8da81870024df5ad8d0f6ed1674a62 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:38.527393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1088/2175] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:38 2022] PUT /identity/v3/projects/543865c55cf746c588995ee150a46262/users/2a1fb1b3897146128e8c85806d95f62f/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:38.531181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.533128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:38.658547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdfbc1-d781-45f5-91d2-5d4fe2636f43 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.755571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.756479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.757148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.757626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.758489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.764838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.779958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1088/2176] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:38.783638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.798760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9493ad-29cf-4662-bc0a-2aa2eb0cb7f2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.806280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.806280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.806280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.806280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] PATH_INFO: `/v3/projects/543865c55cf746c588995ee150a46262/users/2a1fb1b3897146128e8c85806d95f62f/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.815378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543865c55cf746c588995ee150a46262, user_id=2a1fb1b3897146128e8c85806d95f62f, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.818327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.831334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1089/2177] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:38 2022] PUT /identity/v3/projects/543865c55cf746c588995ee150a46262/users/2a1fb1b3897146128e8c85806d95f62f/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:38.876900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:38.879225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:38.894521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce4bb2-9265-4bf9-86e2-4327fa47444a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:38.962616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:38.963397 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:38.963740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:38.964421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] PATH_INFO: `/v3/projects/9bf26214e6424531a2b61b16d25a2e51` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:38.965575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf26214e6424531a2b61b16d25a2e51)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:38.967921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:38.975435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:39.040045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf26214e6424531a2b61b16d25a2e51', 'request_id': 'req-28f5792e-946b-41c7-99e3-8739d5502afa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.046451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf26214e6424531a2b61b16d25a2e51', 'request_id': 'req-28f5792e-946b-41c7-99e3-8739d5502afa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.057266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf26214e6424531a2b61b16d25a2e51', 'request_id': 'req-28f5792e-946b-41c7-99e3-8739d5502afa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.073935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] The token cache is being invalidate because project 9bf26214e6424531a2b61b16d25a2e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:39.074274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.075243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.077496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1089/2178] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:38 2022] DELETE /identity/v3/projects/9bf26214e6424531a2b61b16d25a2e51 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:39.081243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:39.083520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:39.108099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95467fe-c735-4de2-8b8e-e8ecc6eb9364 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:39.149281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:39.224239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:39.224902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:39.225170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:39.225440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] PATH_INFO: `/v3/users/17ec4257b1164f73a18e4475a83e1f7c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:39.228457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ec4257b1164f73a18e4475a83e1f7c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:39.230474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:39.329490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ec4257b1164f73a18e4475a83e1f7c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.342361 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ec4257b1164f73a18e4475a83e1f7c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.365300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ec4257b1164f73a18e4475a83e1f7c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.366307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ec4257b1164f73a18e4475a83e1f7c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.366693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-22f0fcdb-b6c2-4244-ab67-448c400b3c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ec4257b1164f73a18e4475a83e1f7c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:39.394607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1090/2179] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:39 2022] DELETE /identity/v3/users/17ec4257b1164f73a18e4475a83e1f7c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:40.194879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:40.212515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5792e-946b-41c7-99e3-8739d5502afa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:40.286969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:40.288540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:40.289012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:40.289393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] PATH_INFO: `/v3/projects/05e9c975ddf449cdb64b8482dfd09e02` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:40.291294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e9c975ddf449cdb64b8482dfd09e02)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:40.294745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:40.367500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e9c975ddf449cdb64b8482dfd09e02', 'request_id': 'req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:40.378062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e9c975ddf449cdb64b8482dfd09e02', 'request_id': 'req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:40.390517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e9c975ddf449cdb64b8482dfd09e02', 'request_id': 'req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:40.420899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] The token cache is being invalidate because project 05e9c975ddf449cdb64b8482dfd09e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:40.422729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:40.423938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8b0f5b67-00b3-4889-b6ff-fdb7d591a7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:40.430731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1090/2180] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:40 2022] DELETE /identity/v3/projects/05e9c975ddf449cdb64b8482dfd09e02 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:40.436233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df913d-a8bd-48fd-bc56-a9a857c5c3c8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:40.436715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df913d-a8bd-48fd-bc56-a9a857c5c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:40.436715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df913d-a8bd-48fd-bc56-a9a857c5c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:40.495063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-04df913d-a8bd-48fd-bc56-a9a857c5c3c8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:40.495063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-04df913d-a8bd-48fd-bc56-a9a857c5c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:40.601062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1091/2181] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:40.608017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55731-6ced-4960-9a77-8dc3e139443f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:40.608182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55731-6ced-4960-9a77-8dc3e139443f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:40.608498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55731-6ced-4960-9a77-8dc3e139443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:40.637184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-25a55731-6ced-4960-9a77-8dc3e139443f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:40.638504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-25a55731-6ced-4960-9a77-8dc3e139443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:40.657005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1091/2182] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:40.661159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df913d-a8bd-48fd-bc56-a9a857c5c3c8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:40.674217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df913d-a8bd-48fd-bc56-a9a857c5c3c8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:40.688056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:40.688631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:40.688894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:40.689173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:40.689875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:40.690179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:40.695987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:40.720514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1092/2183] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:40.724563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55731-6ced-4960-9a77-8dc3e139443f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:40.735923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55731-6ced-4960-9a77-8dc3e139443f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:40.749416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:40.750026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:40.750294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:40.750564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:40.753130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:40.753441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:40.794241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:40.824385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1092/2184] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:40 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:40.825842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:40.838565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43680bc5-452c-4f51-9693-73882c4227a3 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:40.929400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:40.979430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:40.979430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:40.979658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:40.980076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:40.980747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:40.988064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:41.026787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1093/2185] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:40 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:41.030754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:41.046264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:41.055412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:41.056934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a90293-b719-4fe4-9db3-4672bd4dae51 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:41.070810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:41.071792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.071906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.072298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.073103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:41.075002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:41.087936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58283a1c-6c84-4d38-a1bb-b47788dc23ca admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:41.094760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:41.094975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1093/2186] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:41.095983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:41.096530 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.096988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.097427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] PATH_INFO: `/v3/users/19fd395925f34f7f8cf1bf6bbbb1239f` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.099704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fd395925f34f7f8cf1bf6bbbb1239f)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:41.102461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:41.163701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f55d-d607-459e-bf04-5af0db7d8ed5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:41.182545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:41.183472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.183893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.184789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.185592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:41.187400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:41.221430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1094/2187] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:41.231042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:41.238238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fd395925f34f7f8cf1bf6bbbb1239f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:41.258704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4544a4-994f-44c7-aba1-bf64a24e1501 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:41.284081 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fd395925f34f7f8cf1bf6bbbb1239f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:41.322700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee3636-0284-4908-92c4-94f638ce1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:41.323246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fd395925f34f7f8cf1bf6bbbb1239f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:41.324221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fd395925f34f7f8cf1bf6bbbb1239f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:41.324848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2605a577-4836-4c77-820d-a0745919427d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fd395925f34f7f8cf1bf6bbbb1239f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:41.325151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee3636-0284-4908-92c4-94f638ce1e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.326043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee3636-0284-4908-92c4-94f638ce1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.326458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee3636-0284-4908-92c4-94f638ce1e94 admin admin] PATH_INFO: `/v3/projects/51d36f74581b495998b290e7c91d5522/users/6a00d16269df4e15a0f976a602bae997/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.346138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1094/2188] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:41 2022] DELETE /identity/v3/users/19fd395925f34f7f8cf1bf6bbbb1239f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:41.353601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.354099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.354718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.378236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee3636-0284-4908-92c4-94f638ce1e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d36f74581b495998b290e7c91d5522, user_id=6a00d16269df4e15a0f976a602bae997, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:41.404064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee3636-0284-4908-92c4-94f638ce1e94 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:41.428892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:41.439506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:41.453845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1095/2189] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:41 2022] PUT /identity/v3/projects/51d36f74581b495998b290e7c91d5522/users/6a00d16269df4e15a0f976a602bae997/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:41.456016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.456307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.456580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.586772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] MFA Rules not processed for user `6a00d16269df4e15a0f976a602bae997`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:41.587657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:41.685853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1095/2190] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:41.697880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:41.699820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:41.794482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1096/2191] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:41.795820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:41.804758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:41.822158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:41.845687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2f74d-e848-475c-a5f5-13c87b69f5de None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:41.853034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:41.853868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74104-ddc1-4645-b0c7-250eef321d21 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:41.853992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.854347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.854717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.860695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:41.861556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:41.862069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:41.862537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:41.863687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:41.874263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:41.875696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:41.877636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:41.899243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1096/2192] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:41.952168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1097/2193] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:41 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:41.953481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:41.966630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a5882-28a4-43fb-92a4-9afca1954c7f service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:42.189202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:42.189878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:42.190428 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:42.190428 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:42.191056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:42.196685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:42.246654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1097/2194] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:41 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:42.251127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:42.268483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eadc32-3b92-44d6-8917-17ce85437548 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:42.288183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:42.288960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:42.289245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:42.289516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:42.290180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:42.291928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:42.315037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1098/2195] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:42.318892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:42.333894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee537c-efaa-4450-9f35-d362eeb0fd8b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:42.344484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f65a-092a-4c31-817d-943064a0de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:42.345965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f65a-092a-4c31-817d-943064a0de24 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:42.347220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f65a-092a-4c31-817d-943064a0de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:42.348134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f65a-092a-4c31-817d-943064a0de24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:42.350099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f65a-092a-4c31-817d-943064a0de24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:42.354631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f65a-092a-4c31-817d-943064a0de24 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:42.375658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1098/2196] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:42.380293 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:42.405094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb9de-7e97-4a6d-a614-a90a80581281 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:42.427031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:42.427743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:42.428021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:42.428297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] PATH_INFO: `/v3/projects/8ae81d7fe77343d1aeb23e140329c276/users/1a189f7369104d9699462f096fa82b2d/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:42.484017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae81d7fe77343d1aeb23e140329c276, user_id=1a189f7369104d9699462f096fa82b2d, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:42.486984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:42.558601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1099/2197] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:42 2022] PUT /identity/v3/projects/8ae81d7fe77343d1aeb23e140329c276/users/1a189f7369104d9699462f096fa82b2d/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:42.560397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b2d8-957e-4d43-b89d-131c4ae46fdb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:42.561096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b2d8-957e-4d43-b89d-131c4ae46fdb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:42.561380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b2d8-957e-4d43-b89d-131c4ae46fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:42.593990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:42.595787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:42.682442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-cdd7b2d8-957e-4d43-b89d-131c4ae46fdb None None] MFA Rules not processed for user `1a189f7369104d9699462f096fa82b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:42.683740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cdd7b2d8-957e-4d43-b89d-131c4ae46fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:42.720016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:42.771248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df526-c2c1-430c-b3c2-da4da1ad961b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:42.780425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:42.781301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:42.781625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:42.783369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] PATH_INFO: `/v3/projects/90f76af443a24fc0a529273866c6b1aa` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:42.786129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f76af443a24fc0a529273866c6b1aa)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:42.790395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:42.878648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1099/2198] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:42.885003 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7b2d8-957e-4d43-b89d-131c4ae46fdb None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:42.901640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7b2d8-957e-4d43-b89d-131c4ae46fdb None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:42.902061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f76af443a24fc0a529273866c6b1aa', 'request_id': 'req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:42.916350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f76af443a24fc0a529273866c6b1aa', 'request_id': 'req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:42.935616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f76af443a24fc0a529273866c6b1aa', 'request_id': 'req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:42.954771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] The token cache is being invalidate because project 90f76af443a24fc0a529273866c6b1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:42.955092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:42.955763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1c30a9d3-f0b8-4070-8167-8fe5a28b38bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:42.971229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1100/2199] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:42 2022] DELETE /identity/v3/projects/90f76af443a24fc0a529273866c6b1aa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:42.971229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219254aa-cbdb-4c19-b49d-7ef3cddca24c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:42.971229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219254aa-cbdb-4c19-b49d-7ef3cddca24c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:42.971229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219254aa-cbdb-4c19-b49d-7ef3cddca24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.000255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-219254aa-cbdb-4c19-b49d-7ef3cddca24c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:43.001056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:43.004500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-219254aa-cbdb-4c19-b49d-7ef3cddca24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:43.012399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.013369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.014319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.014742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.015607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.017672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.021287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1101/2200] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:43.030460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad096f-4b8a-4528-b755-2ad50e2190cb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.032355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad096f-4b8a-4528-b755-2ad50e2190cb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.033324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad096f-4b8a-4528-b755-2ad50e2190cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.072760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e1ad096f-4b8a-4528-b755-2ad50e2190cb None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:43.073969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e1ad096f-4b8a-4528-b755-2ad50e2190cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:43.088579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1102/2201] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:31:43.094325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad096f-4b8a-4528-b755-2ad50e2190cb None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.098481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1100/2202] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:42 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:43.102593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.107597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:43.109201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad096f-4b8a-4528-b755-2ad50e2190cb None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.249714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.250473 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.256564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.257197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.257936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:43.260726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.268725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.270910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa5a88-4bde-4db5-bd0b-1eab8887fc4b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.282262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.283197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.284031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.284374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.285225 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.287640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.298651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1103/2203] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:43.303378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.318538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663df7a-2177-41ac-a47d-f1f5569e3cae admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.331631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1101/2204] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:43 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:43.333406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.334235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.335494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.341254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.341829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.342691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.344852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.353517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4697a8-7e72-4eb4-9bb9-e666663a6880 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.366588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.367506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.367927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.368355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.369163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.373035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.394949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1102/2205] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:43.398136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.409477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1104/2206] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:43 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:43.413543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.423628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204caab8-875b-492e-bd41-1f30892d9976 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.492968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:43.540668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06211b83-121b-4a8e-981b-5fd45301f5d2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.546127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.547561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.547860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.548137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] PATH_INFO: `/v3/projects/3cb9632170ac4063bd225b971a2213d1/users/f95ae84aad1b44a8a980ab4eadf28008/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.551107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.553570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.554155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.554781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.555878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.558971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.571341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb9632170ac4063bd225b971a2213d1, user_id=f95ae84aad1b44a8a980ab4eadf28008, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.575833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.610782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1103/2207] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:43 2022] PUT /identity/v3/projects/3cb9632170ac4063bd225b971a2213d1/users/f95ae84aad1b44a8a980ab4eadf28008/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:43.621412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.626805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1105/2208] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:43 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:43.627697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.652193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a8152-aa12-4645-b939-6be2ebb7ab4b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.730172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:43.758117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b04b3e-f940-4ddc-baa1-f30fb873b796 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.765837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.766683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.767166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.767610 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.768699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.770593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.804541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1104/2209] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:43.805467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.825882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.826540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.826798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.827121 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.828632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.837582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f13e2-a33d-4a22-af9f-241a268219e4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.839893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.851920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b387c8-375e-499e-8735-c8f3445c1684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:43.853926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b387c8-375e-499e-8735-c8f3445c1684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.853926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b387c8-375e-499e-8735-c8f3445c1684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.854268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b387c8-375e-499e-8735-c8f3445c1684 admin admin] PATH_INFO: `/v3/projects/3cb9632170ac4063bd225b971a2213d1/users/f95ae84aad1b44a8a980ab4eadf28008/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.856676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b387c8-375e-499e-8735-c8f3445c1684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb9632170ac4063bd225b971a2213d1, user_id=f95ae84aad1b44a8a980ab4eadf28008, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:43.859406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b387c8-375e-499e-8735-c8f3445c1684 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:43.881896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1106/2210] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:43.892525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:43.894185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1105/2211] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:43 2022] PUT /identity/v3/projects/3cb9632170ac4063bd225b971a2213d1/users/f95ae84aad1b44a8a980ab4eadf28008/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:43.896436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:43.896891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:43.897292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:43.925641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861b2a2-7186-4965-8fbf-69be19ad8446 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:43.949755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] MFA Rules not processed for user `f95ae84aad1b44a8a980ab4eadf28008`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:43.957961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:44.093639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:44.094269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:44.094545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:44.094816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:44.095512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:44.097197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:44.129202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1107/2212] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:31:44.130171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:44.133966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1106/2213] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:44.149586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:44.151983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:44.169288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a9e19-8372-4f59-99da-88e0d00783c7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:44.183319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe62537-3d3c-4974-88a6-3a0b5e3d4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:44.184531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62537-3d3c-4974-88a6-3a0b5e3d4164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:44.184817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62537-3d3c-4974-88a6-3a0b5e3d4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:44.185088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62537-3d3c-4974-88a6-3a0b5e3d4164 admin admin] PATH_INFO: `/v3/projects/2043bab32d09423fb33699af52fd5016/users/705d3c0838cd47c68ae47d3159a89f93/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:44.223553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe62537-3d3c-4974-88a6-3a0b5e3d4164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2043bab32d09423fb33699af52fd5016, user_id=705d3c0838cd47c68ae47d3159a89f93, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:44.227284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe62537-3d3c-4974-88a6-3a0b5e3d4164 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:44.262595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1108/2214] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:44 2022] PUT /identity/v3/projects/2043bab32d09423fb33699af52fd5016/users/705d3c0838cd47c68ae47d3159a89f93/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:44.290308 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:44.291440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:44.292046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:44.310653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36faa3f-68a7-4cef-9665-6eacde5ef0bf None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:44.328309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] MFA Rules not processed for user `705d3c0838cd47c68ae47d3159a89f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:44.329681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:44.357800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:44.377068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a4007-1e66-4a63-98f9-3eabee4c7d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:44.378012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4007-1e66-4a63-98f9-3eabee4c7d84 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:44.378012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4007-1e66-4a63-98f9-3eabee4c7d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:44.378295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4007-1e66-4a63-98f9-3eabee4c7d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:44.380042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d08a4007-1e66-4a63-98f9-3eabee4c7d84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:44.415614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:44.431624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1109/2215] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:44.444986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:44.447465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:44.465866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52850e1-5878-4c3e-bd5b-3db6ca15a27a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:44.472830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:44.473463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:44.473744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:44.474019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:44.477041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a4007-1e66-4a63-98f9-3eabee4c7d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:44.478815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a4007-1e66-4a63-98f9-3eabee4c7d84 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:44.484292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:44.486335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:44.488981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1107/2216] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:44.500631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1110/2217] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:45.742465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f683bc-fe9d-4861-9186-f9ce8b334e61 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:45.742965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f683bc-fe9d-4861-9186-f9ce8b334e61 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:45.743044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f683bc-fe9d-4861-9186-f9ce8b334e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:45.772254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-46f683bc-fe9d-4861-9186-f9ce8b334e61 None None] MFA Rules not processed for user `2a1fb1b3897146128e8c85806d95f62f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:45.773461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-46f683bc-fe9d-4861-9186-f9ce8b334e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:45.856669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1108/2218] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:45.872625 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:45.874276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:45.962107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276735bf-7c87-44a8-b09b-161ce9f6497e service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:45.966328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:45.966985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:45.967263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:45.967532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:45.969277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:46.049231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:46.050632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:46.062976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1111/2219] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:46.251339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:46.251634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:46.251910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:46.283254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:46.284786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:46.336771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:46.347931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb29767-707d-439c-aef7-61cc5717764f service glance] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:46.352980 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366381-3784-4691-90de-e0a729712941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:46.353989 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366381-3784-4691-90de-e0a729712941 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:46.354631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366381-3784-4691-90de-e0a729712941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:46.355023 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366381-3784-4691-90de-e0a729712941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:46.356872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-43366381-3784-4691-90de-e0a729712941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:46.389521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1109/2220] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:31:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:46.410535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:46.439752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43366381-3784-4691-90de-e0a729712941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:46.443384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43366381-3784-4691-90de-e0a729712941 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:46.457521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1112/2221] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:31:46.467632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:46.469649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:46.580269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:46.615732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf536ec-0ea4-48fa-81ab-b1acae17a88b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:46.634566 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:46.635936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:46.636482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:46.637022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:46.651739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:46.657510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:46.710567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1110/2222] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:31:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:31:47.513370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366381-3784-4691-90de-e0a729712941 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:47.523739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366381-3784-4691-90de-e0a729712941 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:47.527733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89780cda-7462-44cf-b6db-4b65f5144e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:47.528453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780cda-7462-44cf-b6db-4b65f5144e37 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:47.528842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780cda-7462-44cf-b6db-4b65f5144e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:47.529217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780cda-7462-44cf-b6db-4b65f5144e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:47.605966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89780cda-7462-44cf-b6db-4b65f5144e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:47.607905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89780cda-7462-44cf-b6db-4b65f5144e37 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:47.662870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1113/2223] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:50.903704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:50.905559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:51.129861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec6ab2-6e2e-4238-9ec7-d6037351d5a9 service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:51.143476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:51.143476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:51.143476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:51.143476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] PATH_INFO: `/v3/users/14bdbb163d8043f0bbcee01f0f15e145` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:51.143999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bdbb163d8043f0bbcee01f0f15e145)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:51.157349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:51.254369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bdbb163d8043f0bbcee01f0f15e145'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:51.283766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bdbb163d8043f0bbcee01f0f15e145'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:51.307556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bdbb163d8043f0bbcee01f0f15e145'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:51.309737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bdbb163d8043f0bbcee01f0f15e145'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:51.312020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bdbb163d8043f0bbcee01f0f15e145'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:51.370740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1111/2224] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:50 2022] DELETE /identity/v3/users/14bdbb163d8043f0bbcee01f0f15e145 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:51.375371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:51.376692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:51.377191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:51.419273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:51.420701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:51.593040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1114/2225] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:51.602245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:51.605228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:51.800863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d15125-2d84-4729-bc49-cb583e912263 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:51.805694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:51.806718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:51.807030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:51.807300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:51.831804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:51.837410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:51.874742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1112/2226] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:52.356351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:52.358069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:52.391515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb88fe-9dab-4a0f-b10c-ebcd5ce9a3f5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:52.417038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:52.417749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:52.418025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:52.418295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] PATH_INFO: `/v3/projects/27f3c52fa0f54552a222d7fb0f010e1a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:52.421034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f3c52fa0f54552a222d7fb0f010e1a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:52.423265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:52.516449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:52.517948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:52.528834 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:52.535643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f3c52fa0f54552a222d7fb0f010e1a', 'request_id': 'req-d949692e-2509-4386-9088-71df9d2d5afa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.544250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0ca6-283b-4fcc-8208-42a931d8cc54 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:52.549343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f3c52fa0f54552a222d7fb0f010e1a', 'request_id': 'req-d949692e-2509-4386-9088-71df9d2d5afa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.570251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f3c52fa0f54552a222d7fb0f010e1a', 'request_id': 'req-d949692e-2509-4386-9088-71df9d2d5afa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.573957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:52.602247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] The token cache is being invalidate because project 27f3c52fa0f54552a222d7fb0f010e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:52.602505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.603823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.608709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1115/2227] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:52 2022] DELETE /identity/v3/projects/27f3c52fa0f54552a222d7fb0f010e1a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:52.612761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:52.636277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:52.639766 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:52.640734 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:52.641211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:52.641708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] PATH_INFO: `/v3/users/6a00d16269df4e15a0f976a602bae997` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:52.643286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a00d16269df4e15a0f976a602bae997)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:52.645506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:52.662648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949692e-2509-4386-9088-71df9d2d5afa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:52.671399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:52.672149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:52.674186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:52.676371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] PATH_INFO: `/v3/users/05c092fe4bcb49c3b19b7d1912a112b6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:52.679134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c092fe4bcb49c3b19b7d1912a112b6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:52.681222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:52.748541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a00d16269df4e15a0f976a602bae997'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.778717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a00d16269df4e15a0f976a602bae997'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.810949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c092fe4bcb49c3b19b7d1912a112b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.817189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a00d16269df4e15a0f976a602bae997'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.818409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a00d16269df4e15a0f976a602bae997'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.819989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2b1d5e5a-bef4-439d-adc6-72ff0dd0b105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a00d16269df4e15a0f976a602bae997'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.832807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c092fe4bcb49c3b19b7d1912a112b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.833536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c092fe4bcb49c3b19b7d1912a112b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.834799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c092fe4bcb49c3b19b7d1912a112b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.852963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1113/2228] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:52 2022] DELETE /identity/v3/users/6a00d16269df4e15a0f976a602bae997 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:52.855147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c092fe4bcb49c3b19b7d1912a112b6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:52.858582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:52.859845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:52.861075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:52.899926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:52.902539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:52.903791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1116/2229] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:52 2022] DELETE /identity/v3/users/05c092fe4bcb49c3b19b7d1912a112b6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:53.079124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1114/2230] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:53.079211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:53.079211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:53.238565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcf74c-b87e-4b48-95ef-acf95f8b0580 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:53.254599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777079d-6d51-40db-a478-edb26910262e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:53.256310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777079d-6d51-40db-a478-edb26910262e service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:53.257204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777079d-6d51-40db-a478-edb26910262e service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:53.257624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777079d-6d51-40db-a478-edb26910262e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:53.285152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777079d-6d51-40db-a478-edb26910262e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:53.286639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777079d-6d51-40db-a478-edb26910262e service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:53.306701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1117/2231] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:53.479841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:53.481575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:53.501581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3dfb6-d123-4e28-871d-94b8131cdaea None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:53.511493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:53.512516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:53.512946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:53.513935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] PATH_INFO: `/v3/projects/589f9821b0e542a4bd85b895683aaccd` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:53.517742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=589f9821b0e542a4bd85b895683aaccd)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:53.520169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:53.541659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:53.583298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589f9821b0e542a4bd85b895683aaccd', 'request_id': 'req-412cb738-297b-453b-a434-1ea307aa0a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:53.598334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589f9821b0e542a4bd85b895683aaccd', 'request_id': 'req-412cb738-297b-453b-a434-1ea307aa0a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:53.605397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589f9821b0e542a4bd85b895683aaccd', 'request_id': 'req-412cb738-297b-453b-a434-1ea307aa0a4d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:53.618369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] The token cache is being invalidate because project 589f9821b0e542a4bd85b895683aaccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:53.618874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:53.619900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:53.621798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1115/2232] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:53 2022] DELETE /identity/v3/projects/589f9821b0e542a4bd85b895683aaccd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:53.626787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90bfe-1e13-4fe1-aa23-0df448d3c2d1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:53.629330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90bfe-1e13-4fe1-aa23-0df448d3c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:53.630569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90bfe-1e13-4fe1-aa23-0df448d3c2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:53.658398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-38a90bfe-1e13-4fe1-aa23-0df448d3c2d1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:53.659996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-38a90bfe-1e13-4fe1-aa23-0df448d3c2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:53.686140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:53.690257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:53.756198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1118/2233] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:53.766451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7fade-3968-43fc-9ce9-f4deaef9d142 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:53.766973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7fade-3968-43fc-9ce9-f4deaef9d142 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:53.767472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7fade-3968-43fc-9ce9-f4deaef9d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:53.793794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-95d7fade-3968-43fc-9ce9-f4deaef9d142 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:53.795032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-95d7fade-3968-43fc-9ce9-f4deaef9d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:53.811098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1119/2234] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:53.811298 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb738-297b-453b-a434-1ea307aa0a4d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:53.812383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7fade-3968-43fc-9ce9-f4deaef9d142 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:53.818759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:53.821020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:53.822170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:53.822511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:53.822909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] PATH_INFO: `/v3/projects/51d36f74581b495998b290e7c91d5522` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:53.825487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d36f74581b495998b290e7c91d5522)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:53.827987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:53.832615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7fade-3968-43fc-9ce9-f4deaef9d142 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:53.845142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:53.846396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:53.846740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:53.847106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:53.847834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:53.848196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:53.849888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:53.872918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1120/2235] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:31:53.874054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:53.892260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fd2e9-a008-45a2-ad98-87be7c00d7b5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:53.901465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:53.902195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:53.902529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:53.903363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:53.904081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:53.906416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:53.930710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d36f74581b495998b290e7c91d5522', 'request_id': 'req-28537340-5ebd-4f43-a37f-f2b8538f64cc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:53.955348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1121/2236] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:53 2022] POST /identity/v3/projects => generated 409 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:31:53.967174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:53.975943 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d36f74581b495998b290e7c91d5522', 'request_id': 'req-28537340-5ebd-4f43-a37f-f2b8538f64cc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:53.984453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d36f74581b495998b290e7c91d5522', 'request_id': 'req-28537340-5ebd-4f43-a37f-f2b8538f64cc'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.006863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] The token cache is being invalidate because project 51d36f74581b495998b290e7c91d5522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:54.007159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.014763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.018076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1116/2237] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:53 2022] DELETE /identity/v3/projects/51d36f74581b495998b290e7c91d5522 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:31:54.021716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:54.025026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:54.086689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:54.113280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec8d2-f38f-4fc4-ab3d-a1c5f01e4f46 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:54.119539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:54.120506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:54.120897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:54.121262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:54.121994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:54.125325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:54.142672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28537340-5ebd-4f43-a37f-f2b8538f64cc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:54.151313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:54.152512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:54.152795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:54.153075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] PATH_INFO: `/v3/users/1a189f7369104d9699462f096fa82b2d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:54.155009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a189f7369104d9699462f096fa82b2d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:54.157996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:54.174868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1122/2238] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:53 2022] POST /identity/v3/users => generated 305 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:54.174868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:54.174868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:54.210234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b3aa8-8af9-46eb-b795-cf4b3f93b6be admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:54.228034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:54.228993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:54.229282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:54.230126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:54.230806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:54.232460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:54.235394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a189f7369104d9699462f096fa82b2d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.251151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a189f7369104d9699462f096fa82b2d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.266417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a189f7369104d9699462f096fa82b2d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.267453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a189f7369104d9699462f096fa82b2d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.267879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1123/2239] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:54.268109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a189f7369104d9699462f096fa82b2d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:54.268792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:54.270700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:54.288965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4cb57-6d77-4a37-8d39-4b2b0a3d67a5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:54.289976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1117/2240] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:54 2022] DELETE /identity/v3/users/1a189f7369104d9699462f096fa82b2d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:54.410910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d67a-3bbb-4eb5-98f1-b9c40c154d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:54.411590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d67a-3bbb-4eb5-98f1-b9c40c154d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:54.411869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d67a-3bbb-4eb5-98f1-b9c40c154d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:54.412728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d67a-3bbb-4eb5-98f1-b9c40c154d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:54.414270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d67a-3bbb-4eb5-98f1-b9c40c154d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:54.416303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d67a-3bbb-4eb5-98f1-b9c40c154d14 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:54.434173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1124/2241] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:54.439027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:54.455446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd23f-5801-45c0-83bf-f13b70b29b0f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:54.461523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:54.462421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:54.462792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:54.463279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] PATH_INFO: `/v3/projects/302f751756594d72b7d1a0dcb85d8ce0/users/9e5ebded27404130b065567a9db60625/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:54.516604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=302f751756594d72b7d1a0dcb85d8ce0, user_id=9e5ebded27404130b065567a9db60625, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:54.520879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:54.555883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1118/2242] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:54 2022] PUT /identity/v3/projects/302f751756594d72b7d1a0dcb85d8ce0/users/9e5ebded27404130b065567a9db60625/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:54.572863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c8d8a-43b4-4ebe-89d1-c27ac847cdd7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:54.573145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c8d8a-43b4-4ebe-89d1-c27ac847cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:54.573425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c8d8a-43b4-4ebe-89d1-c27ac847cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:54.618703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4e5c8d8a-43b4-4ebe-89d1-c27ac847cdd7 None None] MFA Rules not processed for user `9e5ebded27404130b065567a9db60625`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:54.620108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4e5c8d8a-43b4-4ebe-89d1-c27ac847cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:54.700934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:54.772495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1125/2243] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:54 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:54.777060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:54.875940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5e85d-ced1-4f0e-986b-a90eb6fefceb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:54.881362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:54.882322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:54.882892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:54.883356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:54.884235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:54.886323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:54.926033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1119/2244] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:54 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:54.930146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c8d8a-43b4-4ebe-89d1-c27ac847cdd7 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:54.945919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c8d8a-43b4-4ebe-89d1-c27ac847cdd7 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:55.025811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:55.026767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.028237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.028728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.029597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:55.032011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:55.068723 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1126/2245] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:54 2022] POST /identity/v3/users => generated 311 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:55.072711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:55.086861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1b29-e62f-47f7-972d-d3367d7e0b01 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:55.099595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:55.110743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.113401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.114988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.115890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:55.121783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:55.158547 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1120/2246] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:55.159878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:55.179873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c685b26-d8be-4ff9-a3b0-7c53cf0e1fa2 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:55.193332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:55.195917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:55.199871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:55.200571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.200850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.201126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] PATH_INFO: `/v3/projects/855d923f83b4436e910418621ddefb2c/users/8aadd46b786e4adfa1892e6204469980/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.216290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:55.225327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bb51f-5caf-41ec-a7ed-ef71e55f099f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:55.241507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:55.242389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.243068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.257104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] PATH_INFO: `/v3/projects/8ae81d7fe77343d1aeb23e140329c276` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.260589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae81d7fe77343d1aeb23e140329c276)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:55.267015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:55.281143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] RBAC: Authorizing `identity:create_grant(project_id=855d923f83b4436e910418621ddefb2c, user_id=8aadd46b786e4adfa1892e6204469980, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:55.291470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:55.323457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1127/2247] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:55 2022] PUT /identity/v3/projects/855d923f83b4436e910418621ddefb2c/users/8aadd46b786e4adfa1892e6204469980/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:55.326069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:55.381901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae81d7fe77343d1aeb23e140329c276', 'request_id': 'req-813f1c6e-b962-43b4-91e7-1f22b7aba72d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.395995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae81d7fe77343d1aeb23e140329c276', 'request_id': 'req-813f1c6e-b962-43b4-91e7-1f22b7aba72d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.406045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae81d7fe77343d1aeb23e140329c276', 'request_id': 'req-813f1c6e-b962-43b4-91e7-1f22b7aba72d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.430758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] The token cache is being invalidate because project 8ae81d7fe77343d1aeb23e140329c276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:55.431877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.432653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.435463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1121/2248] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:55 2022] DELETE /identity/v3/projects/8ae81d7fe77343d1aeb23e140329c276 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:55.440068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:55.442406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:55.504386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c633-0fe2-4ddd-95d2-58075352376a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:55.551963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1c6e-b962-43b4-91e7-1f22b7aba72d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:55.570465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:55.571159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.571433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.571700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] PATH_INFO: `/v3/users/f95ae84aad1b44a8a980ab4eadf28008` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.573848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95ae84aad1b44a8a980ab4eadf28008)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:55.575837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:55.581518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:55.622525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:55.624692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.625159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.625610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.626457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:55.628454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:55.648852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1128/2249] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:55.655700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:55.657635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:55.671387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95ae84aad1b44a8a980ab4eadf28008'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.689494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95ae84aad1b44a8a980ab4eadf28008'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.698518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2cb6-3e7b-401c-80c1-c9fa9722900b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:55.704930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a7d5f-9080-4db0-a657-1d769834d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:55.705830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7d5f-9080-4db0-a657-1d769834d5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.706242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7d5f-9080-4db0-a657-1d769834d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.706662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a7d5f-9080-4db0-a657-1d769834d5ef admin admin] PATH_INFO: `/v3/projects/855d923f83b4436e910418621ddefb2c/users/8aadd46b786e4adfa1892e6204469980/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.710591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a7d5f-9080-4db0-a657-1d769834d5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=855d923f83b4436e910418621ddefb2c, user_id=8aadd46b786e4adfa1892e6204469980, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:55.715597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a7d5f-9080-4db0-a657-1d769834d5ef admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:55.723491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95ae84aad1b44a8a980ab4eadf28008'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.725874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95ae84aad1b44a8a980ab4eadf28008'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.729180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95ae84aad1b44a8a980ab4eadf28008'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:55.730709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1129/2250] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:55 2022] PUT /identity/v3/projects/855d923f83b4436e910418621ddefb2c/users/8aadd46b786e4adfa1892e6204469980/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:55.743869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:55.745455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:55.750097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:55.756712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1122/2251] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:55 2022] DELETE /identity/v3/users/f95ae84aad1b44a8a980ab4eadf28008 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:55.792641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] MFA Rules not processed for user `8aadd46b786e4adfa1892e6204469980`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:55.793770 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:55.907351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1130/2252] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:55 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:55.919583 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:55.921273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:55.932448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:56.066751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19fd20-41aa-4ddc-824c-88e09c6de7f2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:56.092000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:56.092593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.095829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.095829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.132385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:56.133730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:56.157514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1123/2253] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:55 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:56.282661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:56.284606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.373348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:56.379013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.405481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af79d8-a3bb-41f8-95ab-18c16be05398 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:56.425573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:56.426313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.427177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.427556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] PATH_INFO: `/v3/projects/3cb9632170ac4063bd225b971a2213d1` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.428874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb9632170ac4063bd225b971a2213d1)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:56.431070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:56.459022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32912fb0-fd3d-4134-89b6-739dea6cb62a service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:56.468190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:56.469190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.470084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.470382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] PATH_INFO: `/v3/users/705d3c0838cd47c68ae47d3159a89f93` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.472045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705d3c0838cd47c68ae47d3159a89f93)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:56.475000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:56.506498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb9632170ac4063bd225b971a2213d1', 'request_id': 'req-9dc5f72d-2414-472c-b50e-880dbe66e9fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.513157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:56.517015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb9632170ac4063bd225b971a2213d1', 'request_id': 'req-9dc5f72d-2414-472c-b50e-880dbe66e9fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.531659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb9632170ac4063bd225b971a2213d1', 'request_id': 'req-9dc5f72d-2414-472c-b50e-880dbe66e9fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.541883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705d3c0838cd47c68ae47d3159a89f93'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.547771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] The token cache is being invalidate because project 3cb9632170ac4063bd225b971a2213d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:56.548445 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.549359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.551653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1131/2254] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:56 2022] DELETE /identity/v3/projects/3cb9632170ac4063bd225b971a2213d1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:56.552800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:56.556315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.556882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705d3c0838cd47c68ae47d3159a89f93'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.575495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705d3c0838cd47c68ae47d3159a89f93'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.576183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705d3c0838cd47c68ae47d3159a89f93'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.576857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c143d336-ba5b-4ae5-b277-4050462bca16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705d3c0838cd47c68ae47d3159a89f93'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:56.592970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1124/2255] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:31:56 2022] DELETE /identity/v3/users/705d3c0838cd47c68ae47d3159a89f93 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:56.596992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a330-145a-4817-95b8-ccf6960e7d64 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.597277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a330-145a-4817-95b8-ccf6960e7d64 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.597690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a330-145a-4817-95b8-ccf6960e7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.620147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-93c9a330-145a-4817-95b8-ccf6960e7d64 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:56.621355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-93c9a330-145a-4817-95b8-ccf6960e7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.640314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f72d-2414-472c-b50e-880dbe66e9fe admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:56.657776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:56.719233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:56.719845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.720154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.720552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.723580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1125/2256] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:56.725260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c81ccc-1452-4451-b17b-9856f2fbb72f None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.725380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.725554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c81ccc-1452-4451-b17b-9856f2fbb72f None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.725831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c81ccc-1452-4451-b17b-9856f2fbb72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.748501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f5c81ccc-1452-4451-b17b-9856f2fbb72f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:56.749699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f5c81ccc-1452-4451-b17b-9856f2fbb72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.762155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1126/2257] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:56.767780 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.768658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.769755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.794808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:56.796699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.808988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1127/2258] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:56.810123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:56.811840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:56.828958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:56.832124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:56.850434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1132/2259] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:56 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:56.852877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:56.875505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be348af-76c2-455e-9a48-edeeed4bc85f service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:56.882021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:56.883028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.883538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.884154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.885391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:31:56.886259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:56.888858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:56.893038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e277fd-938b-4b45-80ff-2a69ffb729ff None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:56.896873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:56.897872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.897872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.898151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.903877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1133/2260] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:31:56.909117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:56.910603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:56.910724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:56.926235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1128/2261] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:31:56.941442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7696dc2-5476-43fb-aea9-a7dc5fc98cb0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:56.951480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:56.952150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:56.952431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:56.952827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:56.953471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:56.955470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:57.031133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:57.031512 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1134/2262] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:31:56 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:57.046031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632b2c2-5df1-4c3d-b378-8862efffff5a service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:57.207046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:57.208021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:57.209122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:57.209528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:57.211828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:57.214961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:57.283519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1129/2263] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:31:57 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:31:57.288027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:57.302409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:57.305140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:57.312239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499552cf-2a5f-4c6f-b7d6-2ff2d106a5f5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:57.325932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:57.327317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:57.327648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:57.327918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:57.329595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:57.332644 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6393004-8a40-4447-a870-1f68b5f8033e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:57.333150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:57.339673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:57.340537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:57.340901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:57.341238 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] PATH_INFO: `/v3/projects/2043bab32d09423fb33699af52fd5016` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:57.343104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2043bab32d09423fb33699af52fd5016)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:57.354986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:57.373704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1135/2264] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:57.376545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:57.410574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f718db-cf32-45ad-a75a-97cef5729e0c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:57.455650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:57.456314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:57.456653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:57.457406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:57.459487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:57.465508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:57.470558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:57.485783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1136/2265] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:31:57.486260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:57.491629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:57.492962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2043bab32d09423fb33699af52fd5016', 'request_id': 'req-c11b9ffb-360b-442a-ad66-12e09818e776'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:57.509069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098aa1dc-ae85-4ad9-a40d-50674a06a3ce admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:57.523623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2043bab32d09423fb33699af52fd5016', 'request_id': 'req-c11b9ffb-360b-442a-ad66-12e09818e776'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:57.533206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2043bab32d09423fb33699af52fd5016', 'request_id': 'req-c11b9ffb-360b-442a-ad66-12e09818e776'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:57.570880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] The token cache is being invalidate because project 2043bab32d09423fb33699af52fd5016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:31:57.571458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:57.572479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c11b9ffb-360b-442a-ad66-12e09818e776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:31:57.574285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1130/2266] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:31:57 2022] DELETE /identity/v3/projects/2043bab32d09423fb33699af52fd5016 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:57.601488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:57.602556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:57.602733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:57.603168 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] PATH_INFO: `/v3/projects/9fec42ce82a945b8bf8c01778f2e9fe1/users/a101fb6917784b2a9b73e2b249550226/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:57.645698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fec42ce82a945b8bf8c01778f2e9fe1, user_id=a101fb6917784b2a9b73e2b249550226, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:57.653787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:57.677729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1137/2267] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:31:57 2022] PUT /identity/v3/projects/9fec42ce82a945b8bf8c01778f2e9fe1/users/a101fb6917784b2a9b73e2b249550226/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:31:57.757221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04f5b1-45e2-4ed1-a510-b9cb9d33d5eb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:57.757722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04f5b1-45e2-4ed1-a510-b9cb9d33d5eb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:57.757851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04f5b1-45e2-4ed1-a510-b9cb9d33d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:57.793642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fe04f5b1-45e2-4ed1-a510-b9cb9d33d5eb None None] MFA Rules not processed for user `a101fb6917784b2a9b73e2b249550226`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:31:57.794969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fe04f5b1-45e2-4ed1-a510-b9cb9d33d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:57.874742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1131/2268] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:31:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:31:57.887875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:31:57.891958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:31:57.974121 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f5d8b-07ec-4aac-b5ee-062a29f37859 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:31:57.978464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:31:57.979290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:31:57.979713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:31:57.980082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:31:57.992417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:31:57.994047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:31:58.005872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1138/2269] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:31:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:32:00.808748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603136-8699-4797-b7d3-a85b9ec3402e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:00.809316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603136-8699-4797-b7d3-a85b9ec3402e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:00.809316 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57603136-8699-4797-b7d3-a85b9ec3402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:00.832045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-57603136-8699-4797-b7d3-a85b9ec3402e None None] MFA Rules not processed for user `ac8270c824de4344b6ad11acb48f6a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:00.833293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-57603136-8699-4797-b7d3-a85b9ec3402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:00.896847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1132/2270] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:02.955643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:02.959020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:03.064036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5c252-1cdd-405a-85a5-5d6dcb6c0814 service glance] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:03.070503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:03.071610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:03.072034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:03.072472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] PATH_INFO: `/v3/users/9e5ebded27404130b065567a9db60625` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:03.074085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5ebded27404130b065567a9db60625)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:03.076650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:03.114186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:03.148069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5ebded27404130b065567a9db60625'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:03.158803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5ebded27404130b065567a9db60625'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:03.159668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5ebded27404130b065567a9db60625'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:03.160673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5ebded27404130b065567a9db60625'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:03.171203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5fe6dbf0-0c62-43a5-9478-d9975e02d944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5ebded27404130b065567a9db60625'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:03.197696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:03.198670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:03.199115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:03.200520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1139/2271] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:02 2022] DELETE /identity/v3/users/9e5ebded27404130b065567a9db60625 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:03.204752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:03.205861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:03.206262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:03.231403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:03.232855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:03.233785 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:03.235122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:03.322170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1133/2272] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:32:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:03.330263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1140/2273] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:03.340874 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:03.342466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:03.345595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:03.348454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:03.357762 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:03.469042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7ba7b-9971-4ecd-9586-7fa72b1defff None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:03.470776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e1bb9-70d9-4168-bea3-2cbc2571f778 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:03.478941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:03.479712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:03.480134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:03.480511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:03.482027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:03.482872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:03.483405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:03.483827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:03.499771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:03.501733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:03.513905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:03.515301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1141/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:03.516004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:03.528878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1134/2275] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:32:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:32:04.224771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:04.228374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:04.251037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133126-da63-42f9-b7bf-ab36d6c95f11 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:04.256125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:04.256776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:04.257048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:04.257312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] PATH_INFO: `/v3/projects/302f751756594d72b7d1a0dcb85d8ce0` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:04.267212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=302f751756594d72b7d1a0dcb85d8ce0)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:04.270318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:04.327755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:04.334420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302f751756594d72b7d1a0dcb85d8ce0', 'request_id': 'req-1979c622-5b73-4ec1-b237-25242dbe63fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.376305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302f751756594d72b7d1a0dcb85d8ce0', 'request_id': 'req-1979c622-5b73-4ec1-b237-25242dbe63fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.387948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302f751756594d72b7d1a0dcb85d8ce0', 'request_id': 'req-1979c622-5b73-4ec1-b237-25242dbe63fe'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.403681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] The token cache is being invalidate because project 302f751756594d72b7d1a0dcb85d8ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:04.403962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.404704 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.411118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1142/2276] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:04 2022] DELETE /identity/v3/projects/302f751756594d72b7d1a0dcb85d8ce0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:04.412163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:04.427492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebc9b-4d88-4c11-9a35-aabf507964fe service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:04.500837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:04.501903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:04.502426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:04.502946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] PATH_INFO: `/v3/users/8aadd46b786e4adfa1892e6204469980` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:04.504314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aadd46b786e4adfa1892e6204469980)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:04.506679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:04.577681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aadd46b786e4adfa1892e6204469980'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.588188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aadd46b786e4adfa1892e6204469980'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.612000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aadd46b786e4adfa1892e6204469980'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.613010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aadd46b786e4adfa1892e6204469980'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.613628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e5ff2cb7-2dd0-4df5-82b2-3699c8dedcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aadd46b786e4adfa1892e6204469980'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:04.646671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1135/2277] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:04 2022] DELETE /identity/v3/users/8aadd46b786e4adfa1892e6204469980 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:05.015075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:05.016907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:05.047064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979c622-5b73-4ec1-b237-25242dbe63fe admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:05.152140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:05.152785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.153066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.153338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] PATH_INFO: `/v3/projects/855d923f83b4436e910418621ddefb2c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.154865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855d923f83b4436e910418621ddefb2c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:05.158944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:05.243051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855d923f83b4436e910418621ddefb2c', 'request_id': 'req-24142f0f-685c-44dd-aa51-0698599e7509'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:05.249628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855d923f83b4436e910418621ddefb2c', 'request_id': 'req-24142f0f-685c-44dd-aa51-0698599e7509'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:05.267250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855d923f83b4436e910418621ddefb2c', 'request_id': 'req-24142f0f-685c-44dd-aa51-0698599e7509'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:05.282169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] The token cache is being invalidate because project 855d923f83b4436e910418621ddefb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:05.282630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:05.283368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-24142f0f-685c-44dd-aa51-0698599e7509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:05.285278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1143/2278] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:05 2022] DELETE /identity/v3/projects/855d923f83b4436e910418621ddefb2c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:05.291158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082ca53-a8c5-4616-a2da-3d17cba81d3c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.291522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082ca53-a8c5-4616-a2da-3d17cba81d3c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.291869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082ca53-a8c5-4616-a2da-3d17cba81d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.317383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1082ca53-a8c5-4616-a2da-3d17cba81d3c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:05.341912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1082ca53-a8c5-4616-a2da-3d17cba81d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:05.358760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:05.481937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1136/2279] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:05.489941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c96c2-c550-4912-ac32-22adde2fdce6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.490231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c96c2-c550-4912-ac32-22adde2fdce6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.490509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c96c2-c550-4912-ac32-22adde2fdce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.510638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ed3c96c2-c550-4912-ac32-22adde2fdce6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:05.512174 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ed3c96c2-c550-4912-ac32-22adde2fdce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:05.521725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1144/2280] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:05.528087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082ca53-a8c5-4616-a2da-3d17cba81d3c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:05.552432 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082ca53-a8c5-4616-a2da-3d17cba81d3c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:05.557118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:05.557731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.558145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.558419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.559106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:05.559407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:05.561043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:05.572791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1137/2281] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:05.577851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c96c2-c550-4912-ac32-22adde2fdce6 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:05.588737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c96c2-c550-4912-ac32-22adde2fdce6 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:05.593870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:05.594489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.594763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.595070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.595716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:05.597662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:05.636708 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1145/2282] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:05 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:05.640934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:05.650929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f1855-0fe1-4305-81c6-4376aae57b0c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:05.721859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:05.722774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.723087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.723363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.724006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:05.725993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:05.755216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1138/2283] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:05 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:05.756529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:05.767010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85a5b2-79f1-4a67-83b8-5ff009917b65 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:05.772009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:05.772697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.773027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.773324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.774000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:05.775734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:05.790197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1146/2284] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:05.794737 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:05.805947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da9799-a466-4e2a-8d36-20253b219dff admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:05.810927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce574b-6f9a-4b04-8873-b6fa89164458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:05.811620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce574b-6f9a-4b04-8873-b6fa89164458 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.811980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce574b-6f9a-4b04-8873-b6fa89164458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.812318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce574b-6f9a-4b04-8873-b6fa89164458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.813040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce574b-6f9a-4b04-8873-b6fa89164458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:05.814719 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce574b-6f9a-4b04-8873-b6fa89164458 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:05.826377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1139/2285] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:05.830660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:05.841367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafdac2-3efd-4328-84cc-ab08f7bf4366 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:05.846627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:05.847534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.847750 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.848028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] PATH_INFO: `/v3/projects/e4d9da82fc6545a5b3e96205a326afda/users/193ba28dcd494cc69e9a6c602d122ae4/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.869071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d9da82fc6545a5b3e96205a326afda, user_id=193ba28dcd494cc69e9a6c602d122ae4, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:05.872256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:05.876041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:05.890839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1147/2286] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:05 2022] PUT /identity/v3/projects/e4d9da82fc6545a5b3e96205a326afda/users/193ba28dcd494cc69e9a6c602d122ae4/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:05.901273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12387715-f024-492b-bce6-8d3d7bcd088d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:05.901531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12387715-f024-492b-bce6-8d3d7bcd088d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:05.901779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12387715-f024-492b-bce6-8d3d7bcd088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:05.967095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-12387715-f024-492b-bce6-8d3d7bcd088d None None] MFA Rules not processed for user `193ba28dcd494cc69e9a6c602d122ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:05.967095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-12387715-f024-492b-bce6-8d3d7bcd088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:06.101735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1140/2287] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:09.607630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:09.609633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:09.736510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e09e-55e4-426c-9519-eb1bc96e824f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:09.741738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:09.742407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:09.742769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:09.743136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] PATH_INFO: `/v3/users/7cd94aab61a24798bb68b6aaa24c767c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:09.744595 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd94aab61a24798bb68b6aaa24c767c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:09.747213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:09.812688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd94aab61a24798bb68b6aaa24c767c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:09.820984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd94aab61a24798bb68b6aaa24c767c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:09.821577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd94aab61a24798bb68b6aaa24c767c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:09.822172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd94aab61a24798bb68b6aaa24c767c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:09.829149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd94aab61a24798bb68b6aaa24c767c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:09.846359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1148/2288] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:09 2022] DELETE /identity/v3/users/7cd94aab61a24798bb68b6aaa24c767c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:09.851479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:09.852028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:09.852028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:09.872475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:09.873707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:09.884490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:09.939541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1141/2289] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:09.949494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:09.951164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:10.014887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5178144-647e-4d94-8363-1bc8a79772ec admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:10.019224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:10.019865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:10.020245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:10.020497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:10.031264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:10.032746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:10.043735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1149/2290] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:10.392075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:10.393670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:10.426500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee76bd-e4ea-475f-874e-31abf92c92b5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:10.433007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:10.434104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:10.434563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:10.435035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] PATH_INFO: `/v3/projects/34235215e16247ed9960c9c3fcebd483` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:10.446052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=34235215e16247ed9960c9c3fcebd483)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:10.448136 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:10.539964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34235215e16247ed9960c9c3fcebd483', 'request_id': 'req-be7ae318-3761-4c3f-9354-269b5cfab41b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.550436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34235215e16247ed9960c9c3fcebd483', 'request_id': 'req-be7ae318-3761-4c3f-9354-269b5cfab41b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.562704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34235215e16247ed9960c9c3fcebd483', 'request_id': 'req-be7ae318-3761-4c3f-9354-269b5cfab41b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.579654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] The token cache is being invalidate because project 34235215e16247ed9960c9c3fcebd483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:10.580034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.580777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.582640 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1142/2291] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:10 2022] DELETE /identity/v3/projects/34235215e16247ed9960c9c3fcebd483 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:10.586662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:10.598633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b14d-a3c2-44d2-a131-dcfac3d92317 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:10.633710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:10.706553 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:10.707193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:10.707472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:10.707756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] PATH_INFO: `/v3/users/1802ebe3f66d4b81a969a434d07cc1aa` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:10.708993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1802ebe3f66d4b81a969a434d07cc1aa)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:10.711135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:10.798367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1802ebe3f66d4b81a969a434d07cc1aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.814511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1802ebe3f66d4b81a969a434d07cc1aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.816103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1802ebe3f66d4b81a969a434d07cc1aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.818181 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1802ebe3f66d4b81a969a434d07cc1aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.828289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-cd190b66-fc6b-4afb-8065-f0a86e91b5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1802ebe3f66d4b81a969a434d07cc1aa'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:10.854485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1150/2292] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:10 2022] DELETE /identity/v3/users/1802ebe3f66d4b81a969a434d07cc1aa => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:11.180325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:11.182098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:11.196489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae318-3761-4c3f-9354-269b5cfab41b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:11.266572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:11.267156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.267431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.267698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] PATH_INFO: `/v3/projects/8e9daa2b795a45d192e3cc7028499d4b` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.268807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9daa2b795a45d192e3cc7028499d4b)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:11.270720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:11.315776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:11.323670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9daa2b795a45d192e3cc7028499d4b', 'request_id': 'req-c92b15c0-7668-4fc2-bee5-d2510764bd37'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:11.338655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9daa2b795a45d192e3cc7028499d4b', 'request_id': 'req-c92b15c0-7668-4fc2-bee5-d2510764bd37'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:11.346358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9daa2b795a45d192e3cc7028499d4b', 'request_id': 'req-c92b15c0-7668-4fc2-bee5-d2510764bd37'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:11.359120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] The token cache is being invalidate because project 8e9daa2b795a45d192e3cc7028499d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:11.359410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:11.360071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c92b15c0-7668-4fc2-bee5-d2510764bd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:11.361742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1143/2293] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:11 2022] DELETE /identity/v3/projects/8e9daa2b795a45d192e3cc7028499d4b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:11.367030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645d59e-5911-4479-9af4-5574cd37fd49 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.367316 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645d59e-5911-4479-9af4-5574cd37fd49 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.367584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645d59e-5911-4479-9af4-5574cd37fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.388818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4645d59e-5911-4479-9af4-5574cd37fd49 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:11.390140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4645d59e-5911-4479-9af4-5574cd37fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:11.460222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1151/2294] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:11.469868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ecb67-ddbc-43fd-97d3-82e11f14107b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.470155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ecb67-ddbc-43fd-97d3-82e11f14107b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.470460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ecb67-ddbc-43fd-97d3-82e11f14107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.495165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a74ecb67-ddbc-43fd-97d3-82e11f14107b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:11.496527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a74ecb67-ddbc-43fd-97d3-82e11f14107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:11.514708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1144/2295] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:11.519081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645d59e-5911-4479-9af4-5574cd37fd49 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:11.541013 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645d59e-5911-4479-9af4-5574cd37fd49 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:11.545904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:11.546526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.546798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.547131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.547789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:11.548086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:11.549795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:11.563505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1152/2296] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:11.568192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ecb67-ddbc-43fd-97d3-82e11f14107b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:11.577466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ecb67-ddbc-43fd-97d3-82e11f14107b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:11.582053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:11.582767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.583089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.583362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.584008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:11.586099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:11.620921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1145/2297] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:11 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:11.622278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:11.635282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5931ca-72e5-4111-83a1-850b0216fb61 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:11.659064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:11.723323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:11.723617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.723881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.724283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.725231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:11.728354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:11.759213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1153/2298] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:11 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:11.763020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:11.774066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4deec0-5485-48c9-9a55-753e60d17abf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:11.778724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:11.779369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.779689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.779962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.780614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:11.782260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:11.798076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1146/2299] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:11.799314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:11.810867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b9b76-4d19-4ef0-a3e3-93a2f8927719 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:11.815953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccc6ff-5ae3-4d0a-922d-eafee523941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:11.816644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccc6ff-5ae3-4d0a-922d-eafee523941c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.816925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccc6ff-5ae3-4d0a-922d-eafee523941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.817201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccc6ff-5ae3-4d0a-922d-eafee523941c admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.817887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccc6ff-5ae3-4d0a-922d-eafee523941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:11.819790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccc6ff-5ae3-4d0a-922d-eafee523941c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:11.832170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1154/2300] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:11.836501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:11.848004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cc389-896b-4754-b3d0-7f6b4f902b50 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:11.854782 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:11.855540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.855812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.856084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] PATH_INFO: `/v3/projects/87cabd47237142ea8df8e91465f0977e/users/9fdc0d99861741d1a6b69e73276a1545/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.879843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cabd47237142ea8df8e91465f0977e, user_id=9fdc0d99861741d1a6b69e73276a1545, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:11.882533 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:11.897948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1147/2301] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:11 2022] PUT /identity/v3/projects/87cabd47237142ea8df8e91465f0977e/users/9fdc0d99861741d1a6b69e73276a1545/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:11.909498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9880f52-1cc5-4ce1-88be-8237d5cd17e0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:11.909780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9880f52-1cc5-4ce1-88be-8237d5cd17e0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:11.910048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9880f52-1cc5-4ce1-88be-8237d5cd17e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:11.938448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d9880f52-1cc5-4ce1-88be-8237d5cd17e0 None None] MFA Rules not processed for user `9fdc0d99861741d1a6b69e73276a1545`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:11.939737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d9880f52-1cc5-4ce1-88be-8237d5cd17e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:12.035142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1155/2302] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:12.039739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.112269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361436-b99e-40b0-bf55-3ec5d0692ac1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.117622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.118253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.118532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.118806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.119485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.121484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.155397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1148/2303] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:12 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:12.159559 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9880f52-1cc5-4ce1-88be-8237d5cd17e0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.171677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9880f52-1cc5-4ce1-88be-8237d5cd17e0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.240918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.241541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.241814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.242080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.242721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.244838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.272450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1156/2304] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:12 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:12.277084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.288255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c1ba0-e3d2-4aea-a417-99a7ad176887 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.293066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.293706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.293984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.294256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.295000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.296621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.310857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1149/2305] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:12.314126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.324545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c1d93-65a5-421f-a5d2-0754a3db0445 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.329369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.330027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.330300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.330568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] PATH_INFO: `/v3/projects/10d648f6bf00470395ef711ecc372d72/users/4b795ce49dd246fa8df1bd0734c55694/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.348618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d648f6bf00470395ef711ecc372d72, user_id=4b795ce49dd246fa8df1bd0734c55694, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.351352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.360263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:12.369101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1157/2306] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:12 2022] PUT /identity/v3/projects/10d648f6bf00470395ef711ecc372d72/users/4b795ce49dd246fa8df1bd0734c55694/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:12.373137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.384127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78d59-0eef-49f0-a1f9-431214a9a582 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.429616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.431684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:12.445894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:12.475274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.483088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.483698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.484167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.485033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.486970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.499596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1150/2307] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:12.504017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.515145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd24ef-8745-4109-a7d0-0834b5198fc2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.518901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf1230-4e23-47e2-ad9c-69ae06144440 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.520024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae31dd-2b80-4a78-a036-e6847bc30381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.520890 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae31dd-2b80-4a78-a036-e6847bc30381 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.521232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae31dd-2b80-4a78-a036-e6847bc30381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.521594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae31dd-2b80-4a78-a036-e6847bc30381 admin admin] PATH_INFO: `/v3/projects/10d648f6bf00470395ef711ecc372d72/users/4b795ce49dd246fa8df1bd0734c55694/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.522543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.523191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.523460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.523780 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.524172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae31dd-2b80-4a78-a036-e6847bc30381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d648f6bf00470395ef711ecc372d72, user_id=4b795ce49dd246fa8df1bd0734c55694, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.525599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:12.527322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae31dd-2b80-4a78-a036-e6847bc30381 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.543567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1151/2308] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:12 2022] PUT /identity/v3/projects/10d648f6bf00470395ef711ecc372d72/users/4b795ce49dd246fa8df1bd0734c55694/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:12.558347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006f6c5-36cc-4caa-98da-0fc80ca71f90 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.558944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006f6c5-36cc-4caa-98da-0fc80ca71f90 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.559606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006f6c5-36cc-4caa-98da-0fc80ca71f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.609952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7006f6c5-36cc-4caa-98da-0fc80ca71f90 None None] MFA Rules not processed for user `4b795ce49dd246fa8df1bd0734c55694`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:12.611348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7006f6c5-36cc-4caa-98da-0fc80ca71f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:12.612726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.615761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.627452 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1158/2309] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:12.715740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1152/2310] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:12.727434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:12.728880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:12.818311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e708c0-5193-4f91-afc2-d5155b6f9a5f service glance] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:12.882538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:12.883328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:12.883640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:12.883915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:12.896582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:12.898474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:12.911613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1159/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:13.019048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006f6c5-36cc-4caa-98da-0fc80ca71f90 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:13.031538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006f6c5-36cc-4caa-98da-0fc80ca71f90 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:13.035713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6fad6-2e24-442c-b195-ac76a0c67e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:13.036586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6fad6-2e24-442c-b195-ac76a0c67e78 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:13.037023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6fad6-2e24-442c-b195-ac76a0c67e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:13.037388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6fad6-2e24-442c-b195-ac76a0c67e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:13.133769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6fad6-2e24-442c-b195-ac76a0c67e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:13.135416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6fad6-2e24-442c-b195-ac76a0c67e78 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:13.146386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1153/2312] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:32:16.329383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:16.341936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:16.399356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510986-cfd2-4384-b5d4-4980df03a863 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:16.404166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:16.404793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:16.405067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:16.405334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] PATH_INFO: `/v3/users/9fdc0d99861741d1a6b69e73276a1545` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:16.406478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdc0d99861741d1a6b69e73276a1545)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:16.408531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:16.458185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdc0d99861741d1a6b69e73276a1545'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:16.467256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdc0d99861741d1a6b69e73276a1545'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:16.467786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdc0d99861741d1a6b69e73276a1545'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:16.473427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdc0d99861741d1a6b69e73276a1545'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:16.485578 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdc0d99861741d1a6b69e73276a1545'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:16.505544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1160/2313] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:16 2022] DELETE /identity/v3/users/9fdc0d99861741d1a6b69e73276a1545 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:16.510797 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:16.511315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:16.511413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:16.531743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:16.532998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:16.574023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:16.595204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1154/2314] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:16.605325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:16.606977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:16.670220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ce570-a9b0-4a0a-803d-dc0d3d87fc9e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:16.674599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:16.675273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:16.675523 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:16.675792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:16.686673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:16.688449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:16.699130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1161/2315] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:16.992174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:16.993673 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:17.005917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08356999-e413-4acb-8884-713fef2c8e69 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:17.010542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:17.011214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:17.011497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:17.011787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] PATH_INFO: `/v3/projects/87cabd47237142ea8df8e91465f0977e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:17.012938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cabd47237142ea8df8e91465f0977e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:17.014939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:17.064084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cabd47237142ea8df8e91465f0977e', 'request_id': 'req-6e12d470-42e0-4494-8deb-6bb9843b30be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.071697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cabd47237142ea8df8e91465f0977e', 'request_id': 'req-6e12d470-42e0-4494-8deb-6bb9843b30be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.078379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cabd47237142ea8df8e91465f0977e', 'request_id': 'req-6e12d470-42e0-4494-8deb-6bb9843b30be'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.094101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] The token cache is being invalidate because project 87cabd47237142ea8df8e91465f0977e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:17.094391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.095184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.096826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1155/2316] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:16 2022] DELETE /identity/v3/projects/87cabd47237142ea8df8e91465f0977e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:17.101116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:17.111842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684984-6fff-4acf-b7f7-b4dd5d4bfc41 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:17.148118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:17.190036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:17.191950 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:17.192234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:17.192508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] PATH_INFO: `/v3/users/4b795ce49dd246fa8df1bd0734c55694` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:17.193794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b795ce49dd246fa8df1bd0734c55694)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:17.195995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:17.278260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b795ce49dd246fa8df1bd0734c55694'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.290274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b795ce49dd246fa8df1bd0734c55694'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.291248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b795ce49dd246fa8df1bd0734c55694'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.292180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b795ce49dd246fa8df1bd0734c55694'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.308816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-daf036f7-d814-42a1-8a35-80808567db62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b795ce49dd246fa8df1bd0734c55694'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.330601 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1162/2317] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:17 2022] DELETE /identity/v3/users/4b795ce49dd246fa8df1bd0734c55694 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:17.662559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:17.664398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:17.681083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12d470-42e0-4494-8deb-6bb9843b30be admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:17.755746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:17.756524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:17.756830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:17.757130 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] PATH_INFO: `/v3/projects/10d648f6bf00470395ef711ecc372d72` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:17.758335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d648f6bf00470395ef711ecc372d72)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:17.760468 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:17.819522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d648f6bf00470395ef711ecc372d72', 'request_id': 'req-a3d5b439-e491-4a49-bf23-a00ab07898d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.829057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d648f6bf00470395ef711ecc372d72', 'request_id': 'req-a3d5b439-e491-4a49-bf23-a00ab07898d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.836800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d648f6bf00470395ef711ecc372d72', 'request_id': 'req-a3d5b439-e491-4a49-bf23-a00ab07898d3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.852639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:17.865060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] The token cache is being invalidate because project 10d648f6bf00470395ef711ecc372d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:17.865620 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.866503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a3d5b439-e491-4a49-bf23-a00ab07898d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:17.874141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1156/2318] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:17 2022] DELETE /identity/v3/projects/10d648f6bf00470395ef711ecc372d72 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:17.876341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794e57c-6e78-458f-a452-b7cc9ee7e5c8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:17.876526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794e57c-6e78-458f-a452-b7cc9ee7e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:17.876800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794e57c-6e78-458f-a452-b7cc9ee7e5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:17.901529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0794e57c-6e78-458f-a452-b7cc9ee7e5c8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:17.902847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0794e57c-6e78-458f-a452-b7cc9ee7e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:17.976396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1163/2319] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:17.985604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de0d6-0334-4c25-91bc-6721605bd151 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:17.985888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de0d6-0334-4c25-91bc-6721605bd151 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:17.986165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de0d6-0334-4c25-91bc-6721605bd151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.007700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-145de0d6-0334-4c25-91bc-6721605bd151 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:18.009009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-145de0d6-0334-4c25-91bc-6721605bd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:18.024946 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1157/2320] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:18.029406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794e57c-6e78-458f-a452-b7cc9ee7e5c8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.040514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794e57c-6e78-458f-a452-b7cc9ee7e5c8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:18.046138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:18.046761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.047103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.047389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.048058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:18.048364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:18.050157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:18.067657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1164/2321] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:18.068772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de0d6-0334-4c25-91bc-6721605bd151 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.079217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de0d6-0334-4c25-91bc-6721605bd151 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:18.085325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:18.086063 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.086437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.086731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.087489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:18.089909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:18.124097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1158/2322] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:18 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:18.128814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.138891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc248b8-3c7c-4b1e-9afc-6b8ea4b3758f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:18.177006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:18.200043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:18.200664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.200941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.201212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.201852 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:18.204064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:18.226770 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1165/2323] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:18 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:32:18.230887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.241075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9decb-a783-47d0-9b60-7b148adc3f85 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:18.245736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:18.246321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.246565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.246848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.247509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:18.249084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:18.259203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1159/2324] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:18.263080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.272784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fc7aa-15d8-46fb-94cd-0cd23edb576b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:18.277437 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ce4b-a79a-469f-916f-81cffdfbb723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:18.278073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ce4b-a79a-469f-916f-81cffdfbb723 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.278348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ce4b-a79a-469f-916f-81cffdfbb723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.278611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ce4b-a79a-469f-916f-81cffdfbb723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.279340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ce4b-a79a-469f-916f-81cffdfbb723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:18.281081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ce4b-a79a-469f-916f-81cffdfbb723 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:18.293631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1166/2325] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:18.298109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.308760 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7b4c-3ee1-468c-82cc-2ed3956ad203 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:18.313765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:18.314441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.314707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.315020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] PATH_INFO: `/v3/projects/16aff93153ab4a33a6256cf436ef2072/users/883ea8db61b94a1788798b35218bafee/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.337339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16aff93153ab4a33a6256cf436ef2072, user_id=883ea8db61b94a1788798b35218bafee, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:18.340660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:18.455878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1160/2326] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:18 2022] PUT /identity/v3/projects/16aff93153ab4a33a6256cf436ef2072/users/883ea8db61b94a1788798b35218bafee/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:18.457159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b8fe-f556-4f8b-b62b-912a6173aa33 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.457679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b8fe-f556-4f8b-b62b-912a6173aa33 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.457863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b8fe-f556-4f8b-b62b-912a6173aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.507355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9ab5b8fe-f556-4f8b-b62b-912a6173aa33 None None] MFA Rules not processed for user `883ea8db61b94a1788798b35218bafee`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:18.508640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9ab5b8fe-f556-4f8b-b62b-912a6173aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:18.642473 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1167/2327] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:18.646368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.783998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d67c-4323-4458-9263-2f9d438d3980 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:18.799419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:18.800525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:18.800937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:18.801420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:18.802098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:18.804452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:18.874544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1161/2328] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:18 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:32:18.878705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5b8fe-f556-4f8b-b62b-912a6173aa33 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:18.904277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5b8fe-f556-4f8b-b62b-912a6173aa33 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:19.037655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:19.038467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.038857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.039124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.040436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:19.042857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:19.098761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1168/2329] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:18 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:19.105881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:19.115270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9159-e175-499a-84a7-77f0f94b0ddf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:19.123153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:19.123786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.124106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.124497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.125147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:19.126771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:19.165055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1162/2330] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:19.166568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:19.183231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a78a73-a47a-4307-89f2-cfcb1f689ece admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:19.195370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:19.196095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.197668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.197779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] PATH_INFO: `/v3/projects/7c55362558b242dc9dbcb955a17b1d53/users/c42743dc1eb343beac2185ad68e30e19/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.242635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c55362558b242dc9dbcb955a17b1d53, user_id=c42743dc1eb343beac2185ad68e30e19, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:19.246641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:19.281147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1169/2331] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:19 2022] PUT /identity/v3/projects/7c55362558b242dc9dbcb955a17b1d53/users/c42743dc1eb343beac2185ad68e30e19/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:19.285289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:19.311652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102b9ea-7820-447b-908a-2128e657c610 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:19.425056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaef81-93f2-4a6a-a72b-994ee6218ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:19.425679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaef81-93f2-4a6a-a72b-994ee6218ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.425951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaef81-93f2-4a6a-a72b-994ee6218ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.426218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaef81-93f2-4a6a-a72b-994ee6218ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.426898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaef81-93f2-4a6a-a72b-994ee6218ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:19.428649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaef81-93f2-4a6a-a72b-994ee6218ac7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:19.444774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1163/2332] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:19.447246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:19.464774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21b488-f3f5-4b05-9947-a74a99f7b348 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:19.472874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:19.474054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.474054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.474352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] PATH_INFO: `/v3/projects/7c55362558b242dc9dbcb955a17b1d53/users/c42743dc1eb343beac2185ad68e30e19/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.476628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c55362558b242dc9dbcb955a17b1d53, user_id=c42743dc1eb343beac2185ad68e30e19, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:19.479802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:19.488433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:19.495186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1170/2333] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:19 2022] PUT /identity/v3/projects/7c55362558b242dc9dbcb955a17b1d53/users/c42743dc1eb343beac2185ad68e30e19/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:19.505472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.505876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.506194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.526968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:19.549459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] MFA Rules not processed for user `c42743dc1eb343beac2185ad68e30e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:19.550688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:19.654868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1164/2334] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:19.663317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:19.666953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:19.733088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f306b-906b-4c47-b0fc-021ab87bd4f1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:19.737641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2474e5-7fe6-4f46-a2ab-1adce3b85180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:19.738260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2474e5-7fe6-4f46-a2ab-1adce3b85180 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.738536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2474e5-7fe6-4f46-a2ab-1adce3b85180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.739012 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2474e5-7fe6-4f46-a2ab-1adce3b85180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.749871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2474e5-7fe6-4f46-a2ab-1adce3b85180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:19.751647 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2474e5-7fe6-4f46-a2ab-1adce3b85180 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:19.763971 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1171/2335] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:19.820922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:19.822550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:19.835167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb605c-6e1c-4553-b567-5594fe106497 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:19.839386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:19.840006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:19.840343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:19.840616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:19.908285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:19.909748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:19.919503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1165/2336] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:20.700870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356e95-16c1-43a3-a41c-568d90cbc3e3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:20.701941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356e95-16c1-43a3-a41c-568d90cbc3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:20.702467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356e95-16c1-43a3-a41c-568d90cbc3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:20.740722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-da356e95-16c1-43a3-a41c-568d90cbc3e3 None None] MFA Rules not processed for user `0e421a45c825416fa5bf4aec29ed0c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:20.742887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-da356e95-16c1-43a3-a41c-568d90cbc3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:20.833928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1172/2337] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:23.547696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:23.619655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6a316-b8a0-4468-82e9-2d8430537fe8 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:23.626331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:23.627300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:23.627653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:23.628006 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] PATH_INFO: `/v3/users/883ea8db61b94a1788798b35218bafee` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:23.629714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883ea8db61b94a1788798b35218bafee)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:23.631824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:23.671517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:23.689463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883ea8db61b94a1788798b35218bafee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:23.698253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883ea8db61b94a1788798b35218bafee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:23.717710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883ea8db61b94a1788798b35218bafee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:23.718599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883ea8db61b94a1788798b35218bafee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:23.719213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883ea8db61b94a1788798b35218bafee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:23.752474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1166/2338] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:23 2022] DELETE /identity/v3/users/883ea8db61b94a1788798b35218bafee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:23.756995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:23.757460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:23.757648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:23.779301 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:23.780498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:23.851428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1173/2339] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:23.860957 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:23.862645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:23.932553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967c56-a478-4d88-813f-be5205499ed7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:23.936585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:23.937049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:23.937337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:23.937635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:23.948064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:23.949621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:23.959700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1167/2340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:24.306716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:24.310196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:24.324188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b734-507f-497c-9160-3b4d66221b58 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:24.330052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:24.330894 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:24.331254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:24.331626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] PATH_INFO: `/v3/projects/16aff93153ab4a33a6256cf436ef2072` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:24.333837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=16aff93153ab4a33a6256cf436ef2072)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:24.335981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:24.395219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:24.400421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16aff93153ab4a33a6256cf436ef2072', 'request_id': 'req-b8eb9373-ff40-4fe6-81c2-a751abf947fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.411107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16aff93153ab4a33a6256cf436ef2072', 'request_id': 'req-b8eb9373-ff40-4fe6-81c2-a751abf947fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.427037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16aff93153ab4a33a6256cf436ef2072', 'request_id': 'req-b8eb9373-ff40-4fe6-81c2-a751abf947fd'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.448488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] The token cache is being invalidate because project 16aff93153ab4a33a6256cf436ef2072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:24.448892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.450184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.452305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1174/2341] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:24 2022] DELETE /identity/v3/projects/16aff93153ab4a33a6256cf436ef2072 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:24.456491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:24.468590 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80edd0b-cb1a-4ee4-b7a2-9b0537dd9a0f service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:24.549053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:24.550654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:24.551247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:24.551747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] PATH_INFO: `/v3/users/c42743dc1eb343beac2185ad68e30e19` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:24.557634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42743dc1eb343beac2185ad68e30e19)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:24.560020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:24.637458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42743dc1eb343beac2185ad68e30e19'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.656380 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42743dc1eb343beac2185ad68e30e19'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.658334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:24.686092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42743dc1eb343beac2185ad68e30e19'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.689906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42743dc1eb343beac2185ad68e30e19'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.691031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42743dc1eb343beac2185ad68e30e19'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:24.724891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1168/2342] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:24 2022] DELETE /identity/v3/users/c42743dc1eb343beac2185ad68e30e19 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:25.253414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:25.255583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:25.271054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9373-ff40-4fe6-81c2-a751abf947fd admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:25.377474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:25.378224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.378857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.378857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] PATH_INFO: `/v3/users/a101fb6917784b2a9b73e2b249550226` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.380655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a101fb6917784b2a9b73e2b249550226)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:25.383790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:25.449558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a101fb6917784b2a9b73e2b249550226'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.460782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a101fb6917784b2a9b73e2b249550226'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.461915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a101fb6917784b2a9b73e2b249550226'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.462805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a101fb6917784b2a9b73e2b249550226'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.473659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-e9425fff-f25f-46c3-bc26-236184d8e619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a101fb6917784b2a9b73e2b249550226'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.489550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:25.491512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:25.506187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1175/2343] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:25 2022] DELETE /identity/v3/users/a101fb6917784b2a9b73e2b249550226 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:25.514125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.514467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.514732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.523588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59ad05-fb74-4266-9126-6b77ff5c3b4b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:25.545101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:25.546338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:25.589956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:25.590722 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.591027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.591469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] PATH_INFO: `/v3/projects/7c55362558b242dc9dbcb955a17b1d53` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.592772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c55362558b242dc9dbcb955a17b1d53)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:25.594979 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:25.598403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:25.623867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1176/2344] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:25.640976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:25.643536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:25.657741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c55362558b242dc9dbcb955a17b1d53', 'request_id': 'req-681bd076-2933-47fc-99c2-2396c6f9ecee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.667107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c55362558b242dc9dbcb955a17b1d53', 'request_id': 'req-681bd076-2933-47fc-99c2-2396c6f9ecee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.673980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c55362558b242dc9dbcb955a17b1d53', 'request_id': 'req-681bd076-2933-47fc-99c2-2396c6f9ecee'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.686500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] The token cache is being invalidate because project 7c55362558b242dc9dbcb955a17b1d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:25.686729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.687408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-681bd076-2933-47fc-99c2-2396c6f9ecee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:25.689207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1169/2345] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:25 2022] DELETE /identity/v3/projects/7c55362558b242dc9dbcb955a17b1d53 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:25.695283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d449a-cc3d-4fa3-abe1-b8653a7e4c6d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.695579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d449a-cc3d-4fa3-abe1-b8653a7e4c6d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.695879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d449a-cc3d-4fa3-abe1-b8653a7e4c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.719869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8c4d449a-cc3d-4fa3-abe1-b8653a7e4c6d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:25.720325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f19f49-af2f-48e7-aa07-754068a6579c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:25.721395 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8c4d449a-cc3d-4fa3-abe1-b8653a7e4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:25.781803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:25.781803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.781803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.781803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.785756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:25.819333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1170/2346] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:25.828293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fb25-99b1-459f-9fa9-baf016e8d9a3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.828579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fb25-99b1-459f-9fa9-baf016e8d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.828947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fb25-99b1-459f-9fa9-baf016e8d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.837293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:25.863066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec07fb25-99b1-459f-9fa9-baf016e8d9a3 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:25.865972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec07fb25-99b1-459f-9fa9-baf016e8d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:25.881240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1171/2347] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:25.885967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07fb25-99b1-459f-9fa9-baf016e8d9a3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:25.891573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:25.893055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:25.895439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07fb25-99b1-459f-9fa9-baf016e8d9a3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:25.900504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:25.901224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.901598 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.901960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.903100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1177/2348] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:32:25.903471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:25.903842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:25.905625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:25.919312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1172/2349] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:25.923622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:25.939106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9334499-6abb-4ad9-8ae6-0f6e10730a81 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:25.952002 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:25.952796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:25.953180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:25.953550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:25.954412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:25.956818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:25.999498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1178/2350] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:25 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:32:26.000742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.015005 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4195d-c18f-4da4-abdc-9d62a8d1c49c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.108982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.109622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.109903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.110755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.111546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.114408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.146282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1173/2351] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:25 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:26.150410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.177715 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38eb64-f8a5-4087-9dbb-72f02127cf23 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.193695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.194583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.195060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.196442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.197937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.199726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.219618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1179/2352] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:32:26.223976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.251203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b5df-b081-43fb-9c74-2c6fdaa191a2 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.266319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228227-de62-4af4-bc17-f1d2dd8c69a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.267301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228227-de62-4af4-bc17-f1d2dd8c69a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.267891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228227-de62-4af4-bc17-f1d2dd8c69a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.270929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228227-de62-4af4-bc17-f1d2dd8c69a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.271731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228227-de62-4af4-bc17-f1d2dd8c69a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.273589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228227-de62-4af4-bc17-f1d2dd8c69a0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.294998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1174/2353] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:26.298738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.310959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac6b8e-8caf-417e-b52a-3c5b9a3166f5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.315969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.316643 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.316925 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.317414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] PATH_INFO: `/v3/projects/682a4eb961a343dc801581564f742390/users/7d748f060a484dc59839f1e602b8b84a/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.334675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=682a4eb961a343dc801581564f742390, user_id=7d748f060a484dc59839f1e602b8b84a, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.338020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.352128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:26.358866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1180/2354] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:26 2022] PUT /identity/v3/projects/682a4eb961a343dc801581564f742390/users/7d748f060a484dc59839f1e602b8b84a/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:26.369221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013affa-98be-4ed1-b484-7937cbe80f6b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.369458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013affa-98be-4ed1-b484-7937cbe80f6b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.370176 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013affa-98be-4ed1-b484-7937cbe80f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.417652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f013affa-98be-4ed1-b484-7937cbe80f6b None None] MFA Rules not processed for user `7d748f060a484dc59839f1e602b8b84a`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:26.418969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f013affa-98be-4ed1-b484-7937cbe80f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:26.433917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.436690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:26.520987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1175/2355] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:26.531691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013affa-98be-4ed1-b484-7937cbe80f6b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.563110 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013affa-98be-4ed1-b484-7937cbe80f6b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.580214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ed0d-ba69-4362-817d-2a0565188a4d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.592605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.594139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.595207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.595434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.595562 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.595833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] PATH_INFO: `/v3/projects/9fec42ce82a945b8bf8c01778f2e9fe1` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.596534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.597688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fec42ce82a945b8bf8c01778f2e9fe1)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.598808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.599432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.600320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.606280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.674624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1176/2356] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:26 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:26.680018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.724484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:26.743716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fec42ce82a945b8bf8c01778f2e9fe1', 'request_id': 'req-9ec4ec31-369b-46b9-8ed7-2739157c9307'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:26.759849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fec42ce82a945b8bf8c01778f2e9fe1', 'request_id': 'req-9ec4ec31-369b-46b9-8ed7-2739157c9307'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:26.780841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fec42ce82a945b8bf8c01778f2e9fe1', 'request_id': 'req-9ec4ec31-369b-46b9-8ed7-2739157c9307'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:26.808653 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] The token cache is being invalidate because project 9fec42ce82a945b8bf8c01778f2e9fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:26.808946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:26.809748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9ec4ec31-369b-46b9-8ed7-2739157c9307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:26.812252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e538-71c0-4850-b3fe-70daa5b63bbd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.817644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1181/2357] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:26 2022] DELETE /identity/v3/projects/9fec42ce82a945b8bf8c01778f2e9fe1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:26.819670 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c2ac-e8f2-4e21-8ff3-b3e9991a0433 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.820075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c2ac-e8f2-4e21-8ff3-b3e9991a0433 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.822451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c2ac-e8f2-4e21-8ff3-b3e9991a0433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.857456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-01f1c2ac-e8f2-4e21-8ff3-b3e9991a0433 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:26.859204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-01f1c2ac-e8f2-4e21-8ff3-b3e9991a0433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:26.927328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.928160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.928507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.929339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.930124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.932897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.949032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1182/2358] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:26.957883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1177/2359] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:26 2022] POST /identity/v3/users => generated 299 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:26.959161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304c94a-52b8-4983-b442-4bf1d23a003b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.959493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304c94a-52b8-4983-b442-4bf1d23a003b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.959769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304c94a-52b8-4983-b442-4bf1d23a003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.964902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:26.967700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:26.980542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e242a2-71c9-4b8a-8de8-44777ad9e8a8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:26.981714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6304c94a-52b8-4983-b442-4bf1d23a003b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:26.983373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6304c94a-52b8-4983-b442-4bf1d23a003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:26.985833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:26.986643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:26.986971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:26.987244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:26.987921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:26.989502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:26.996748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1183/2360] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:26.999059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304c94a-52b8-4983-b442-4bf1d23a003b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.001046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1178/2361] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:27.004844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.012166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304c94a-52b8-4983-b442-4bf1d23a003b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.015898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91eca-e999-414c-aaac-6a8fae1269b5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.017116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.018115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.018396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.018669 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.019364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:27.019663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.021317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.022369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.023525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.024026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.024308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] PATH_INFO: `/v3/projects/1b80825b2de841229a49262407d1b205/users/98c0f62d09114ea983cff9ff3b2863e5/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.037779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1184/2362] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:32:27.038707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.043861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b80825b2de841229a49262407d1b205, user_id=98c0f62d09114ea983cff9ff3b2863e5, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.048029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.050483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3235-1cfe-4930-b4e0-a2853a1f1945 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.056507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.057279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.057538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.057909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.058554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.060506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.063496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1179/2363] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:27 2022] PUT /identity/v3/projects/1b80825b2de841229a49262407d1b205/users/98c0f62d09114ea983cff9ff3b2863e5/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:27.067597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.075226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:27.100792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1185/2364] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:27 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:27.105082 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.149562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcc8ef-fce9-42ef-a62e-bcebb361d7b9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.193461 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:27.210597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236fb08-9d09-4dbd-a185-b92febdebb98 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.219593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.220699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.221431 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.221933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.222992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.225975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.232134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.232694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.232853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.233147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.233809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.235736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.248555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1180/2365] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:27.253088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.263155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1186/2366] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:27 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:27.267390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.279789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c59ede-e7f8-4d72-8590-78e68d7ac54c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.285168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2c35-22b1-428d-8c14-a1e50158e6ab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.290344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.290344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.295375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.295973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.297266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.301216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc8b5-f869-4dd9-a9c7-ad4f74fb3cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.301817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.303408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc8b5-f869-4dd9-a9c7-ad4f74fb3cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.303720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc8b5-f869-4dd9-a9c7-ad4f74fb3cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.304016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc8b5-f869-4dd9-a9c7-ad4f74fb3cd5 admin admin] PATH_INFO: `/v3/projects/1b80825b2de841229a49262407d1b205/users/98c0f62d09114ea983cff9ff3b2863e5/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.310885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc8b5-f869-4dd9-a9c7-ad4f74fb3cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b80825b2de841229a49262407d1b205, user_id=98c0f62d09114ea983cff9ff3b2863e5, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.316876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc8b5-f869-4dd9-a9c7-ad4f74fb3cd5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.326063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1187/2367] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:32:27.327739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.343214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1181/2368] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:27 2022] PUT /identity/v3/projects/1b80825b2de841229a49262407d1b205/users/98c0f62d09114ea983cff9ff3b2863e5/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:27.357839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59861fa-14c4-4a4e-9fa3-69b854e93767 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.363391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.363669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.363938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.398426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] MFA Rules not processed for user `98c0f62d09114ea983cff9ff3b2863e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:27.400036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:27.427793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.429624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.429624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.429624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.429863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.443315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.467837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1188/2369] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:32:27.468809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.483521 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86029ca-1ef8-430e-9aba-b2ce75a23bf8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.489244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe5b9-0af6-4841-b46d-7eb73c23fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.490033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe5b9-0af6-4841-b46d-7eb73c23fe07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.490375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe5b9-0af6-4841-b46d-7eb73c23fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.491057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe5b9-0af6-4841-b46d-7eb73c23fe07 admin admin] PATH_INFO: `/v3/projects/d189a31cd41a48bba81ce7fa2af2bfac/users/34b94bf9d356456a96f3158f5a4578c2/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.511086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1182/2370] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:27.515367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe5b9-0af6-4841-b46d-7eb73c23fe07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d189a31cd41a48bba81ce7fa2af2bfac, user_id=34b94bf9d356456a96f3158f5a4578c2, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.518216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe5b9-0af6-4841-b46d-7eb73c23fe07 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.519949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.521345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:27.536089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1189/2371] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:27 2022] PUT /identity/v3/projects/d189a31cd41a48bba81ce7fa2af2bfac/users/34b94bf9d356456a96f3158f5a4578c2/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:27.548845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.549133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.549992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.599394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd7d2a-35dc-40df-9d2c-0b4dfbe54cbc None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.618467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] MFA Rules not processed for user `34b94bf9d356456a96f3158f5a4578c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:27.622950 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:27.666424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64037e43-1b5d-484d-8351-623a47c67702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.667186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64037e43-1b5d-484d-8351-623a47c67702 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.667579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64037e43-1b5d-484d-8351-623a47c67702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.672985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64037e43-1b5d-484d-8351-623a47c67702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.676638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-64037e43-1b5d-484d-8351-623a47c67702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:27.695497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:27.701998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:27.769358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64037e43-1b5d-484d-8351-623a47c67702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.771845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64037e43-1b5d-484d-8351-623a47c67702 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.781554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1190/2372] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:27.791338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1183/2373] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:32:27.796042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:27.797893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:27.812631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c434880-78ee-42f4-af41-eb1b5c8e579b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:27.816718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:27.817546 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:27.818241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:27.818690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:27.835063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:27.837822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:27.864756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1191/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:28.591767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f16bb-0aca-491e-be8f-8a129cd5af3d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:28.592179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f16bb-0aca-491e-be8f-8a129cd5af3d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:28.592830 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f16bb-0aca-491e-be8f-8a129cd5af3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:28.622537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e77f16bb-0aca-491e-be8f-8a129cd5af3d None None] MFA Rules not processed for user `ea21235f22f14e6f8e9649c65f8a683f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:28.624579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e77f16bb-0aca-491e-be8f-8a129cd5af3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:28.697412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1184/2375] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:29.968319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:29.969922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:30.071137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d8f25-c64a-4900-a5f5-ce130a63e7cf service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:30.079962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:30.081399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:30.081981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:30.083047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] PATH_INFO: `/v3/users/193ba28dcd494cc69e9a6c602d122ae4` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:30.084528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] RBAC: Authorizing `identity:delete_user(user_id=193ba28dcd494cc69e9a6c602d122ae4)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:30.090016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:30.164871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193ba28dcd494cc69e9a6c602d122ae4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:30.181123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193ba28dcd494cc69e9a6c602d122ae4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:30.182108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193ba28dcd494cc69e9a6c602d122ae4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:30.183067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193ba28dcd494cc69e9a6c602d122ae4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:30.193582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193ba28dcd494cc69e9a6c602d122ae4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:30.218988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1192/2376] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:29 2022] DELETE /identity/v3/users/193ba28dcd494cc69e9a6c602d122ae4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:30.223505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:30.224022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:30.224172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:30.261986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:30.263360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:30.329078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1185/2377] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:30.335442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:30.337029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:30.383619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:30.411143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328fcb1-577a-463e-9f5a-3a13733a134c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:30.418163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fec9d-985c-4f1f-b779-45c95e5a9e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:30.418876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fec9d-985c-4f1f-b779-45c95e5a9e0b service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:30.419172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fec9d-985c-4f1f-b779-45c95e5a9e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:30.422328 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fec9d-985c-4f1f-b779-45c95e5a9e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:30.433018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fec9d-985c-4f1f-b779-45c95e5a9e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:30.434479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fec9d-985c-4f1f-b779-45c95e5a9e0b service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:30.445474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1193/2378] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:30.826718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:30.828866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:30.869273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a97ba-ea14-4531-854f-b0a5b8d04a41 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:30.879601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:30.880318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:30.880601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:30.880942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] PATH_INFO: `/v3/projects/e4d9da82fc6545a5b3e96205a326afda` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:30.883516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d9da82fc6545a5b3e96205a326afda)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:30.885126 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:30.973060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d9da82fc6545a5b3e96205a326afda', 'request_id': 'req-4add5641-0bc5-428b-ba82-1c22175c6752'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:30.984151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d9da82fc6545a5b3e96205a326afda', 'request_id': 'req-4add5641-0bc5-428b-ba82-1c22175c6752'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:30.986346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:31.009158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d9da82fc6545a5b3e96205a326afda', 'request_id': 'req-4add5641-0bc5-428b-ba82-1c22175c6752'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:31.024310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] The token cache is being invalidate because project e4d9da82fc6545a5b3e96205a326afda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:31.024660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:31.025366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4add5641-0bc5-428b-ba82-1c22175c6752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:31.035157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1186/2379] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:30 2022] DELETE /identity/v3/projects/e4d9da82fc6545a5b3e96205a326afda => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:31.038390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa854-9056-4ec7-a338-ca02ab083a4d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.038941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa854-9056-4ec7-a338-ca02ab083a4d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.040633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa854-9056-4ec7-a338-ca02ab083a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.089758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9b1fa854-9056-4ec7-a338-ca02ab083a4d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:31.091103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9b1fa854-9056-4ec7-a338-ca02ab083a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:31.189675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1194/2380] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:31.200207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460528-5f96-4253-9f3c-66dc4b026055 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.200496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460528-5f96-4253-9f3c-66dc4b026055 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.200823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460528-5f96-4253-9f3c-66dc4b026055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.256559 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-bd460528-5f96-4253-9f3c-66dc4b026055 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:31.258454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bd460528-5f96-4253-9f3c-66dc4b026055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:31.270321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1187/2381] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:31.274627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa854-9056-4ec7-a338-ca02ab083a4d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:31.285419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa854-9056-4ec7-a338-ca02ab083a4d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:31.291067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:31.291767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.292052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.292385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.311408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:31.311408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:31.311408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:31.360177 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1195/2382] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:31.364714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd460528-5f96-4253-9f3c-66dc4b026055 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:31.377118 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd460528-5f96-4253-9f3c-66dc4b026055 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:31.382052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:31.382667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.383022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.383506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.384146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:31.386342 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:31.429143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1188/2383] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:31 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:31.435504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:31.462790 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3456c5-eca5-43e5-823a-943da98ffe1d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:31.520847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:31.521459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.521766 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.522029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.522668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:31.524637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:31.546031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1196/2384] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:31 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:32:31.550261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:31.560746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cab7d-7046-4016-b9b2-98c956affcfe admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:31.566531 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:31.567182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.567462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.567727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.568359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:31.569965 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:31.580274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1189/2385] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:32:31.584280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:31.595247 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6324a3-3f6d-4b6c-a22e-1c33ec0b3031 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:31.601163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee70e7-b408-4a78-b1e1-7561ef3352fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:31.601741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee70e7-b408-4a78-b1e1-7561ef3352fd admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.602035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee70e7-b408-4a78-b1e1-7561ef3352fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.602300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee70e7-b408-4a78-b1e1-7561ef3352fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.602976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee70e7-b408-4a78-b1e1-7561ef3352fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:31.604585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee70e7-b408-4a78-b1e1-7561ef3352fd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:31.615484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1197/2386] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:31.626101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:31.637466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5345da-13cd-49c1-948a-a0190f3bad2c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:31.643592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:31.644517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.644863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.645205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] PATH_INFO: `/v3/projects/93f69e244647422392142aa7c2942ff9/users/2e0ed91f78b345c0a7b273a61aa15508/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.662777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f69e244647422392142aa7c2942ff9, user_id=2e0ed91f78b345c0a7b273a61aa15508, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:31.665797 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:31.683932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1190/2387] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:31 2022] PUT /identity/v3/projects/93f69e244647422392142aa7c2942ff9/users/2e0ed91f78b345c0a7b273a61aa15508/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:31.695450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1407524-41a0-4e89-ad51-ef1209b0906d None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.695829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1407524-41a0-4e89-ad51-ef1209b0906d None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.696180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1407524-41a0-4e89-ad51-ef1209b0906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.728463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c1407524-41a0-4e89-ad51-ef1209b0906d None None] MFA Rules not processed for user `2e0ed91f78b345c0a7b273a61aa15508`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:31.729875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c1407524-41a0-4e89-ad51-ef1209b0906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:31.773930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:31.834878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1198/2388] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:31.856755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:31.859210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:31.936215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0cb73-791b-4d26-9682-82ddfdf908aa admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:31.940522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:31.941345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:31.941770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:31.942173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:31.952320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:31.953801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:31.975010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1191/2389] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:32.597737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1407524-41a0-4e89-ad51-ef1209b0906d None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:32.607286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1407524-41a0-4e89-ad51-ef1209b0906d None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:32.611091 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34448607-c179-4546-bf59-231e4534a03a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:32.611726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34448607-c179-4546-bf59-231e4534a03a service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:32.612007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34448607-c179-4546-bf59-231e4534a03a service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:32.612279 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34448607-c179-4546-bf59-231e4534a03a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:32.614070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-34448607-c179-4546-bf59-231e4534a03a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:32.676257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34448607-c179-4546-bf59-231e4534a03a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:32.677713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34448607-c179-4546-bf59-231e4534a03a service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:32.687429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1199/2390] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:33.275851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:33.277404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:33.359215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97b2f3-0b95-4643-b07d-bdec55129629 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:33.364162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:33.364929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:33.365340 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:33.365680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] PATH_INFO: `/v3/users/34b94bf9d356456a96f3158f5a4578c2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:33.366927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b94bf9d356456a96f3158f5a4578c2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:33.368976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:33.412431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:33.444715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b94bf9d356456a96f3158f5a4578c2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:33.454653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b94bf9d356456a96f3158f5a4578c2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:33.477268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b94bf9d356456a96f3158f5a4578c2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:33.477955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b94bf9d356456a96f3158f5a4578c2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:33.478584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b94bf9d356456a96f3158f5a4578c2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:33.505716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1192/2391] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:33 2022] DELETE /identity/v3/users/34b94bf9d356456a96f3158f5a4578c2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:33.511089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68514a-27ed-4c83-90d7-8ebc6bf86b5f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:33.511552 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68514a-27ed-4c83-90d7-8ebc6bf86b5f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:33.522849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68514a-27ed-4c83-90d7-8ebc6bf86b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:33.535786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4c68514a-27ed-4c83-90d7-8ebc6bf86b5f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:33.537205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4c68514a-27ed-4c83-90d7-8ebc6bf86b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:33.675583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1200/2392] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:33.687846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:33.689633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:33.764129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa9f7-bcd7-4015-ac5b-3b9044908f77 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:33.770104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:33.771043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:33.771406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:33.771742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:33.784374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:33.785858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:33.795921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1193/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:34.151926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68514a-27ed-4c83-90d7-8ebc6bf86b5f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:34.162706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68514a-27ed-4c83-90d7-8ebc6bf86b5f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:34.167628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:34.168582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:34.168956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:34.169290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:34.172005 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:34.246132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:34.247736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:34.260896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1201/2394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:32:34.358868 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:34.361196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:34.377223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166037-b180-4945-a832-01700ae2364f service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:34.386472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:34.390030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:34.409119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:34.410591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] PATH_INFO: `/v3/projects/d189a31cd41a48bba81ce7fa2af2bfac` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:34.414145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d189a31cd41a48bba81ce7fa2af2bfac)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:34.417573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:34.487404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd189a31cd41a48bba81ce7fa2af2bfac', 'request_id': 'req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.499363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd189a31cd41a48bba81ce7fa2af2bfac', 'request_id': 'req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.508568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd189a31cd41a48bba81ce7fa2af2bfac', 'request_id': 'req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.523412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] The token cache is being invalidate because project d189a31cd41a48bba81ce7fa2af2bfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:34.523921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.524607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ebb4a43d-4e65-4ca0-a8ca-e53b373b30b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.526426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1194/2395] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:34 2022] DELETE /identity/v3/projects/d189a31cd41a48bba81ce7fa2af2bfac => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:34.660260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:34.661792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:34.672932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:34.698137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bc6c-0d5b-4e73-9d36-e80f335d6d7b service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:34.802289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:34.804142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:34.804631 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:34.805173 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] PATH_INFO: `/v3/users/2e0ed91f78b345c0a7b273a61aa15508` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:34.806709 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0ed91f78b345c0a7b273a61aa15508)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:34.810165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:34.886571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0ed91f78b345c0a7b273a61aa15508'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.896493 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0ed91f78b345c0a7b273a61aa15508'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.899942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0ed91f78b345c0a7b273a61aa15508'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.900775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0ed91f78b345c0a7b273a61aa15508'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.918599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0ed91f78b345c0a7b273a61aa15508'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:34.962384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1202/2396] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:34 2022] DELETE /identity/v3/users/2e0ed91f78b345c0a7b273a61aa15508 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:34.967854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:34.968359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:34.968661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:34.993555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:34.995146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:35.028489 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:35.077074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1195/2397] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:35.107284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:35.109881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:35.181831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ca065-30fc-4d1f-be61-d4fbe246c244 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:35.188305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:35.189039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:35.189319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:35.190752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:35.217252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:35.218860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:35.229747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1203/2398] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:36.180589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:36.182171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:36.195904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0b0e1-9be0-4214-8148-8ffb9a7ab567 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:36.201505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:36.202149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:36.202427 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:36.203270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] PATH_INFO: `/v3/projects/93f69e244647422392142aa7c2942ff9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:36.204526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f69e244647422392142aa7c2942ff9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:36.206477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:36.261221 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f69e244647422392142aa7c2942ff9', 'request_id': 'req-c99d4367-06bf-4ee7-a2d4-20018aa8914d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:36.269823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f69e244647422392142aa7c2942ff9', 'request_id': 'req-c99d4367-06bf-4ee7-a2d4-20018aa8914d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:36.275882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f69e244647422392142aa7c2942ff9', 'request_id': 'req-c99d4367-06bf-4ee7-a2d4-20018aa8914d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:36.287174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] The token cache is being invalidate because project 93f69e244647422392142aa7c2942ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:36.287445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:36.288696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-c99d4367-06bf-4ee7-a2d4-20018aa8914d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:36.290258 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1196/2399] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:36 2022] DELETE /identity/v3/projects/93f69e244647422392142aa7c2942ff9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:37.797323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:37.799707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:37.826222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821489b5-cac8-48e2-a69e-430c337eb05e service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:37.886116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:38.020492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:38.027048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:38.027607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:38.028850 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] PATH_INFO: `/v3/users/7d748f060a484dc59839f1e602b8b84a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:38.034164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d748f060a484dc59839f1e602b8b84a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:38.037102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:38.119425 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d748f060a484dc59839f1e602b8b84a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:38.138929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d748f060a484dc59839f1e602b8b84a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:38.139518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d748f060a484dc59839f1e602b8b84a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:38.140202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d748f060a484dc59839f1e602b8b84a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:38.153352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d748f060a484dc59839f1e602b8b84a'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:38.191192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1204/2400] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:37 2022] DELETE /identity/v3/users/7d748f060a484dc59839f1e602b8b84a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:38.192281 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:38.193181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:38.193626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:38.218331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:38.220123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:38.308348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1197/2401] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:38.321913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:38.323527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:38.407608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775379c-c0e6-41db-a730-0998dbe14f15 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:38.412056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:38.412693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:38.413351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:38.413351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:38.434028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:38.435748 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:38.447522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1205/2402] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:39.051050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:39.052642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:39.068158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fab0c-41cb-4bfd-b92f-a6f803bb2806 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:39.073922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:39.074978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:39.075434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:39.075870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] PATH_INFO: `/v3/projects/682a4eb961a343dc801581564f742390` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:39.077558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] RBAC: Authorizing `identity:delete_project(project_id=682a4eb961a343dc801581564f742390)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:39.079833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:39.157215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:39.159939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682a4eb961a343dc801581564f742390', 'request_id': 'req-18ef5ddd-6047-443b-bed4-0438a620987b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.171816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682a4eb961a343dc801581564f742390', 'request_id': 'req-18ef5ddd-6047-443b-bed4-0438a620987b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.182061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682a4eb961a343dc801581564f742390', 'request_id': 'req-18ef5ddd-6047-443b-bed4-0438a620987b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.199727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] The token cache is being invalidate because project 682a4eb961a343dc801581564f742390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:39.201338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.202794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.205071 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1198/2403] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:39 2022] DELETE /identity/v3/projects/682a4eb961a343dc801581564f742390 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:39.209360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:39.223111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe2ad0-da51-43c6-86f5-530374134d6c service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:39.275044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:39.292175 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:39.293311 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:39.293805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:39.294228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] PATH_INFO: `/v3/users/98c0f62d09114ea983cff9ff3b2863e5` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:39.295994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c0f62d09114ea983cff9ff3b2863e5)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:39.298798 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:39.390537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c0f62d09114ea983cff9ff3b2863e5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.401207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c0f62d09114ea983cff9ff3b2863e5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.401973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c0f62d09114ea983cff9ff3b2863e5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.402629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c0f62d09114ea983cff9ff3b2863e5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.411053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f06dfc-30e3-4008-8e19-28eec4c2cd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c0f62d09114ea983cff9ff3b2863e5'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:39.432245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1206/2404] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:39 2022] DELETE /identity/v3/users/98c0f62d09114ea983cff9ff3b2863e5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:39.919419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:39.920958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:39.938843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef5ddd-6047-443b-bed4-0438a620987b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:40.016012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:40.017234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.017696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.017966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] PATH_INFO: `/v3/projects/1b80825b2de841229a49262407d1b205` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.019169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b80825b2de841229a49262407d1b205)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:40.021178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:40.079818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b80825b2de841229a49262407d1b205', 'request_id': 'req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:40.091519 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b80825b2de841229a49262407d1b205', 'request_id': 'req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:40.101299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b80825b2de841229a49262407d1b205', 'request_id': 'req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:40.123953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] The token cache is being invalidate because project 1b80825b2de841229a49262407d1b205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:40.125687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:40.127291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-0489070e-2a75-4325-ab0b-e6d15cbe0e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:40.130122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1199/2405] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:39 2022] DELETE /identity/v3/projects/1b80825b2de841229a49262407d1b205 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:40.135823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ccf38-53d4-4eaf-888e-df0fa1e136da None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.136119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ccf38-53d4-4eaf-888e-df0fa1e136da None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.136383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ccf38-53d4-4eaf-888e-df0fa1e136da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.165129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c41ccf38-53d4-4eaf-888e-df0fa1e136da None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:40.166364 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c41ccf38-53d4-4eaf-888e-df0fa1e136da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:40.236823 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1207/2406] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:40.245113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2bd36-0a06-41dc-b42e-eab4f7bd75b5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.245552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2bd36-0a06-41dc-b42e-eab4f7bd75b5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.245691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2bd36-0a06-41dc-b42e-eab4f7bd75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.280699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-dec2bd36-0a06-41dc-b42e-eab4f7bd75b5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:40.282164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-dec2bd36-0a06-41dc-b42e-eab4f7bd75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:40.292004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1200/2407] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:40.296969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ccf38-53d4-4eaf-888e-df0fa1e136da None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:40.316099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ccf38-53d4-4eaf-888e-df0fa1e136da None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:40.322127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:40.323071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.323494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.323910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.324934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:40.325399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:40.327391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:40.349120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1208/2408] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:40.349983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2bd36-0a06-41dc-b42e-eab4f7bd75b5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:40.371039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2bd36-0a06-41dc-b42e-eab4f7bd75b5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:40.386488 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:40.387664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.387934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.388199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.388865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:40.396439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:40.435481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1201/2409] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:40 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:32:40.439314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:40.451779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ed067-1f6f-4275-93df-132cc12ba98d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:40.537548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:40.555658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:40.558115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.558401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.563321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.563321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:40.564227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:40.634450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1209/2410] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:40 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:32:40.635246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:40.661329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122cdb0-0552-4028-9105-2bb7d0900548 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:40.666184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:40.666889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.667119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.667394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.668039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:40.669700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:40.680930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1202/2411] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:40.684502 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:40.702187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c90abb-f77a-4f9e-8ffc-e9f807f1de22 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:40.707315 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db6718-9dba-4a0d-93cc-836948904f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:40.707932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6718-9dba-4a0d-93cc-836948904f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.708203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6718-9dba-4a0d-93cc-836948904f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.708468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6718-9dba-4a0d-93cc-836948904f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.709109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db6718-9dba-4a0d-93cc-836948904f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:40.710763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db6718-9dba-4a0d-93cc-836948904f36 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:40.723060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1210/2412] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:40.727051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:40.738044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d028f-8e09-49fd-af2e-c674689530dd admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:40.743284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:40.744058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.744425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.744810 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] PATH_INFO: `/v3/projects/d95ed63a5b3440edabf4eb1a5897158e/users/e3e5e8d09e6840cbaf56171aa2e11155/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.760986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95ed63a5b3440edabf4eb1a5897158e, user_id=e3e5e8d09e6840cbaf56171aa2e11155, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:40.763967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:40.808541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1203/2413] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:40 2022] PUT /identity/v3/projects/d95ed63a5b3440edabf4eb1a5897158e/users/e3e5e8d09e6840cbaf56171aa2e11155/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:40.811120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b89e-461f-4c92-a1b7-a36d332c010e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:40.811609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b89e-461f-4c92-a1b7-a36d332c010e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:40.811768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b89e-461f-4c92-a1b7-a36d332c010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:40.866537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ba76b89e-461f-4c92-a1b7-a36d332c010e None None] MFA Rules not processed for user `e3e5e8d09e6840cbaf56171aa2e11155`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:40.873144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ba76b89e-461f-4c92-a1b7-a36d332c010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:40.956377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1211/2414] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:40.969856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:40.972553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:40.978476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:41.053664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcc4f4-a3fb-48be-b3fb-5fbcdf855ec7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:41.057916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650c853-955c-4bca-aff3-3cd91c29de7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:41.058541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650c853-955c-4bca-aff3-3cd91c29de7b service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:41.058842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650c853-955c-4bca-aff3-3cd91c29de7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:41.059567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650c853-955c-4bca-aff3-3cd91c29de7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:41.071693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650c853-955c-4bca-aff3-3cd91c29de7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:41.073446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650c853-955c-4bca-aff3-3cd91c29de7b service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:41.083713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1204/2415] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:41.106370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b89e-461f-4c92-a1b7-a36d332c010e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:41.177056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b89e-461f-4c92-a1b7-a36d332c010e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:41.182321 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:41.183111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:41.183487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:41.183857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] PATH_INFO: `/v3/users/e3e5e8d09e6840cbaf56171aa2e11155` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:41.185236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e5e8d09e6840cbaf56171aa2e11155)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:41.187246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:41.240367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e5e8d09e6840cbaf56171aa2e11155'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.249036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e5e8d09e6840cbaf56171aa2e11155'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.249641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e5e8d09e6840cbaf56171aa2e11155'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.250348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e5e8d09e6840cbaf56171aa2e11155'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.257619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e5e8d09e6840cbaf56171aa2e11155'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.258732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:41.279413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1212/2416] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:41 2022] DELETE /identity/v3/users/e3e5e8d09e6840cbaf56171aa2e11155 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:41.283944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:41.284463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:41.284463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:41.304669 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:41.305917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:41.366426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1205/2417] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:41.376705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:41.378125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:41.441472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57fe78-b927-45f7-b39b-79a65c076a15 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:41.445340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc4dab-fc85-4db2-b51e-bbe2b5140525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:41.445960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc4dab-fc85-4db2-b51e-bbe2b5140525 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:41.446239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc4dab-fc85-4db2-b51e-bbe2b5140525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:41.446902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc4dab-fc85-4db2-b51e-bbe2b5140525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:41.456759 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc4dab-fc85-4db2-b51e-bbe2b5140525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:41.458217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc4dab-fc85-4db2-b51e-bbe2b5140525 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:41.471205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1213/2418] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:41.893367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:41.894855 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:41.907470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433408-ee75-4281-98b3-1babc1be0549 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:41.913482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:41.914211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:41.914551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:41.914912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] PATH_INFO: `/v3/projects/d95ed63a5b3440edabf4eb1a5897158e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:41.916283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95ed63a5b3440edabf4eb1a5897158e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:41.918419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:41.970925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95ed63a5b3440edabf4eb1a5897158e', 'request_id': 'req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.980807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95ed63a5b3440edabf4eb1a5897158e', 'request_id': 'req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.987072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95ed63a5b3440edabf4eb1a5897158e', 'request_id': 'req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.998597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] The token cache is being invalidate because project d95ed63a5b3440edabf4eb1a5897158e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:41.998921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:41.999582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-cd8bfb88-b7b2-4c6e-a525-359a8430fdb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:42.001207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1206/2419] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:41 2022] DELETE /identity/v3/projects/d95ed63a5b3440edabf4eb1a5897158e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:42.006246 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bfd0-42d5-43d9-9738-4b80a5ea6ba2 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.006571 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bfd0-42d5-43d9-9738-4b80a5ea6ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.006992 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bfd0-42d5-43d9-9738-4b80a5ea6ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.026906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b122bfd0-42d5-43d9-9738-4b80a5ea6ba2 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:42.028133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b122bfd0-42d5-43d9-9738-4b80a5ea6ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:42.088375 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1214/2420] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:42.097105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11a2f3-723f-4520-92e3-45fcb8491277 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.097463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11a2f3-723f-4520-92e3-45fcb8491277 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.097734 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11a2f3-723f-4520-92e3-45fcb8491277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.123501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-8b11a2f3-723f-4520-92e3-45fcb8491277 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:42.124851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8b11a2f3-723f-4520-92e3-45fcb8491277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:42.133217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1207/2421] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:32:42.137468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122bfd0-42d5-43d9-9738-4b80a5ea6ba2 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.147260 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122bfd0-42d5-43d9-9738-4b80a5ea6ba2 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.151994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.152695 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.153034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.153370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.154118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:42.154480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.156274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.168122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1215/2422] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:42.172323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11a2f3-723f-4520-92e3-45fcb8491277 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.181495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11a2f3-723f-4520-92e3-45fcb8491277 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.186543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.187314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.187600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.187878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.188517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.190420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.213989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:42.221539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1208/2423] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:42 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:42.225614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.236032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc425e17-4bcd-4901-af52-b0303e0421ea admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.303867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.304561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.304681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.304949 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.305600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.307583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.326685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:42.332821 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1216/2424] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:42 2022] POST /identity/v3/users => generated 281 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:42.337331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.348027 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a7cd-9ea5-4eb5-a68f-e1c2faecf09e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.352729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.353325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.353600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.353863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.354500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.356145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.366112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1209/2425] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:32:42.370238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.381075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25275d0c-79fc-4c90-9225-caf94188dcd5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.386414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a0e51-6eaa-4f41-907f-d60f5702839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.387052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a0e51-6eaa-4f41-907f-d60f5702839a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.387324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a0e51-6eaa-4f41-907f-d60f5702839a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.387590 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a0e51-6eaa-4f41-907f-d60f5702839a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.388231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a0e51-6eaa-4f41-907f-d60f5702839a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.389833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a0e51-6eaa-4f41-907f-d60f5702839a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.401048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1217/2426] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:32:42.405345 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.415658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f116d-9214-431a-82bf-73acce5d9640 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.421818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.422509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.422787 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.423087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] PATH_INFO: `/v3/projects/5475a40da35d4af68717bef58773d22e/users/3217e1dcaa2d45fca29502544ce2f78f/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.439744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5475a40da35d4af68717bef58773d22e, user_id=3217e1dcaa2d45fca29502544ce2f78f, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.442406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.458058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1210/2427] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:42 2022] PUT /identity/v3/projects/5475a40da35d4af68717bef58773d22e/users/3217e1dcaa2d45fca29502544ce2f78f/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:42.470742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79783b6-b9ab-4c6f-b56d-8f2c90d1a14c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.471049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79783b6-b9ab-4c6f-b56d-8f2c90d1a14c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.471319 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79783b6-b9ab-4c6f-b56d-8f2c90d1a14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.499077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b79783b6-b9ab-4c6f-b56d-8f2c90d1a14c None None] MFA Rules not processed for user `3217e1dcaa2d45fca29502544ce2f78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:42.500316 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b79783b6-b9ab-4c6f-b56d-8f2c90d1a14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:42.564073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1218/2428] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:42.597371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.599235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:42.657814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fbe53-167b-406b-bc49-c8c392956ab8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.661812 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564aa37-3b14-4459-b3d2-2efaed2d7bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.662522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564aa37-3b14-4459-b3d2-2efaed2d7bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.662697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564aa37-3b14-4459-b3d2-2efaed2d7bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.663013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564aa37-3b14-4459-b3d2-2efaed2d7bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.671869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564aa37-3b14-4459-b3d2-2efaed2d7bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.673339 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564aa37-3b14-4459-b3d2-2efaed2d7bf2 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.682611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1211/2429] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:42.698314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79783b6-b9ab-4c6f-b56d-8f2c90d1a14c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:42.767099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79783b6-b9ab-4c6f-b56d-8f2c90d1a14c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:42.772380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:42.773020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.773294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.773585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] PATH_INFO: `/v3/users/3217e1dcaa2d45fca29502544ce2f78f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.774741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3217e1dcaa2d45fca29502544ce2f78f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:42.776999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:42.824836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3217e1dcaa2d45fca29502544ce2f78f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:42.833574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3217e1dcaa2d45fca29502544ce2f78f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:42.834253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3217e1dcaa2d45fca29502544ce2f78f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:42.835031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3217e1dcaa2d45fca29502544ce2f78f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:42.842530 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3217e1dcaa2d45fca29502544ce2f78f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:42.855304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:42.863616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1219/2430] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:32:42 2022] DELETE /identity/v3/users/3217e1dcaa2d45fca29502544ce2f78f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:32:42.865818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:42.866060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:42.866337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:42.899120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:42.905435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:42.989259 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1212/2431] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:43.004881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.006570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:43.078711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3567d-9f20-40aa-9ba7-bac5ddbda368 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.082472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cafaa-d66a-480f-a842-2b7bdc3d4050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.083256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cafaa-d66a-480f-a842-2b7bdc3d4050 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.083528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cafaa-d66a-480f-a842-2b7bdc3d4050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.083803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cafaa-d66a-480f-a842-2b7bdc3d4050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.095190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cafaa-d66a-480f-a842-2b7bdc3d4050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.096662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cafaa-d66a-480f-a842-2b7bdc3d4050 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.107734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1220/2432] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:43.383328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.385592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:43.399718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41265b8-50f4-4ca2-ad07-d1003927cecd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.405049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.405859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.406196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.406462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] PATH_INFO: `/v3/projects/5475a40da35d4af68717bef58773d22e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.407686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5475a40da35d4af68717bef58773d22e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.409726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.456079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5475a40da35d4af68717bef58773d22e', 'request_id': 'req-36f90707-4bd1-48c6-82fc-d898940353d0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:43.465699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5475a40da35d4af68717bef58773d22e', 'request_id': 'req-36f90707-4bd1-48c6-82fc-d898940353d0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:43.470739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:43.471909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5475a40da35d4af68717bef58773d22e', 'request_id': 'req-36f90707-4bd1-48c6-82fc-d898940353d0'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:43.485569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] The token cache is being invalidate because project 5475a40da35d4af68717bef58773d22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:32:43.485857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:43.486493 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-36f90707-4bd1-48c6-82fc-d898940353d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:32:43.488034 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1213/2433] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:32:43 2022] DELETE /identity/v3/projects/5475a40da35d4af68717bef58773d22e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:43.494068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c6f1-60d9-498a-9220-cb59311aa5e8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.494533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c6f1-60d9-498a-9220-cb59311aa5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.494627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c6f1-60d9-498a-9220-cb59311aa5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.515820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c4a4c6f1-60d9-498a-9220-cb59311aa5e8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:43.517042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c4a4c6f1-60d9-498a-9220-cb59311aa5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:43.597532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1221/2434] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:43.605662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dafa0-64e0-4f66-bf66-3358c6ebec6c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.605907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dafa0-64e0-4f66-bf66-3358c6ebec6c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.606196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dafa0-64e0-4f66-bf66-3358c6ebec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.626555 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-187dafa0-64e0-4f66-bf66-3358c6ebec6c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:43.627721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-187dafa0-64e0-4f66-bf66-3358c6ebec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:43.636282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1214/2435] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:43.640690 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c6f1-60d9-498a-9220-cb59311aa5e8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.650381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c6f1-60d9-498a-9220-cb59311aa5e8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.655046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.655794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.656065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.656326 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.656968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:32:43.657263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.658862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.670218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1222/2436] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:32:43.674532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dafa0-64e0-4f66-bf66-3358c6ebec6c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.683994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dafa0-64e0-4f66-bf66-3358c6ebec6c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.689474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.690065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.690338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.690605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.691271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.693165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.723191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1215/2437] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:32:43 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:43.727396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.740155 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b231-0710-4ecf-9ff8-3483429917e1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.813199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.813804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.814074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.814338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.815049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.818085 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.844510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1223/2438] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:32:43 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:32:43.848408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.858656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ace56-8a24-4bea-8009-4a52b1ee18db admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.863841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.864658 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.865115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.865378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.866054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.867680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.878346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1216/2439] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:43.882345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.892600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6005-742d-4aa0-bf22-f9168b84954e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.897872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0f0b-d894-4fc3-b436-c3a9b0205efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.898555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0f0b-d894-4fc3-b436-c3a9b0205efc admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.899037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0f0b-d894-4fc3-b436-c3a9b0205efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.899306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0f0b-d894-4fc3-b436-c3a9b0205efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.900073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee0f0b-d894-4fc3-b436-c3a9b0205efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.901937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee0f0b-d894-4fc3-b436-c3a9b0205efc admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.918370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1224/2440] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:32:43.922899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:43.937277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9b31e-35f7-4911-972a-6e22f0fea011 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:43.942384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:43.943253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.943602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.943941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] PATH_INFO: `/v3/projects/6fd8f8d6fc5e4c37bbc3c1fe2c694367/users/ae9091eb1d47401ebfdf45a5260d2864/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:43.959008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd8f8d6fc5e4c37bbc3c1fe2c694367, user_id=ae9091eb1d47401ebfdf45a5260d2864, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:43.961755 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:43.978335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1217/2441] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:32:43 2022] PUT /identity/v3/projects/6fd8f8d6fc5e4c37bbc3c1fe2c694367/users/ae9091eb1d47401ebfdf45a5260d2864/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:32:43.989651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f1ab9-b9a4-489d-8bea-752dca972093 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:43.989944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f1ab9-b9a4-489d-8bea-752dca972093 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:43.990214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f1ab9-b9a4-489d-8bea-752dca972093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:44.003285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:44.018655 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e87f1ab9-b9a4-489d-8bea-752dca972093 None None] MFA Rules not processed for user `ae9091eb1d47401ebfdf45a5260d2864`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:44.019911 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e87f1ab9-b9a4-489d-8bea-752dca972093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:44.083706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1225/2442] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:44.095822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:32:44.097882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:44.155242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fe7a8-b119-4595-88d6-9a2ebe1f649b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:32:44.158892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d80247-d0bd-499d-aaeb-873dbb6cb719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:32:44.159581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80247-d0bd-499d-aaeb-873dbb6cb719 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:44.159919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80247-d0bd-499d-aaeb-873dbb6cb719 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:44.160267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80247-d0bd-499d-aaeb-873dbb6cb719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:44.169387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d80247-d0bd-499d-aaeb-873dbb6cb719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:32:44.170990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d80247-d0bd-499d-aaeb-873dbb6cb719 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:32:44.180595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1218/2443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:32:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:45.575624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:32:45.576202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:32:45.576202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:32:45.596128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] MFA Rules not processed for user `ae9091eb1d47401ebfdf45a5260d2864`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:32:45.597371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:32:45.608044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1226/2444] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:32:54.176413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:55.590545 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=32 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:00.652125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931e85a-00b8-423c-9c3a-d484ac81afc2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:00.652610 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931e85a-00b8-423c-9c3a-d484ac81afc2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:00.652718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931e85a-00b8-423c-9c3a-d484ac81afc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:00.671967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-3931e85a-00b8-423c-9c3a-d484ac81afc2 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:00.673166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3931e85a-00b8-423c-9c3a-d484ac81afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:00.728732 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1219/2445] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:33:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:33:00.750862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:00.752361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:00.823207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6d3b0-6027-46b7-aa5b-d99fe0b5b6e1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:00.829014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:00.829615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:00.829891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:00.830156 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:00.839180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:00.840907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:00.849370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1227/2446] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:33:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:33:01.383768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6f569-f0d8-4294-ad10-d978c595eef6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:01.384052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6f569-f0d8-4294-ad10-d978c595eef6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:01.384322 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6f569-f0d8-4294-ad10-d978c595eef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:01.404423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c5a6f569-f0d8-4294-ad10-d978c595eef6 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:01.405612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c5a6f569-f0d8-4294-ad10-d978c595eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:01.414435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1220/2447] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 15 07:33:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:33:01.427243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:01.438141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6de1c-40f2-4708-9cfd-802e72ca11a4 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:01.443972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:01.444570 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:01.444840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:01.445104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:01.453696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:01.455329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:01.469987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1228/2448] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:33:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 07:33:01.743545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720faa-a5ee-4c4a-a01d-d4ab16d4b6ef None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:01.744010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720faa-a5ee-4c4a-a01d-d4ab16d4b6ef None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:01.744116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720faa-a5ee-4c4a-a01d-d4ab16d4b6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:01.764411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-55720faa-a5ee-4c4a-a01d-d4ab16d4b6ef None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:01.765599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-55720faa-a5ee-4c4a-a01d-d4ab16d4b6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:01.773765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1221/2449] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:33:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:33:01.787763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:01.803720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a47b21-46b4-4a35-8dba-4b05141cba1f service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:01.812169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:01.812760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:01.813063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:01.813302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:01.823538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:01.825212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:01.837223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1229/2450] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:33:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:33:02.187286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16dd4e-4104-4148-8847-78bf8e0a064d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:02.187565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16dd4e-4104-4148-8847-78bf8e0a064d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:02.187814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16dd4e-4104-4148-8847-78bf8e0a064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:02.209650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4d16dd4e-4104-4148-8847-78bf8e0a064d None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:02.210963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4d16dd4e-4104-4148-8847-78bf8e0a064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:02.218955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1222/2451] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 15 07:33:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:33:02.236047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:02.246730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d1bdd-4277-4835-b0b3-d8ea286138dc service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:02.252422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ec28-c68b-4625-9d28-f526551f312a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:02.253030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ec28-c68b-4625-9d28-f526551f312a service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:02.253307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ec28-c68b-4625-9d28-f526551f312a service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:02.253576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ec28-c68b-4625-9d28-f526551f312a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:02.261796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ec28-c68b-4625-9d28-f526551f312a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:02.263443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ec28-c68b-4625-9d28-f526551f312a service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:02.271497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1230/2452] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:33:04.570804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16dd4e-4104-4148-8847-78bf8e0a064d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:04.643521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16dd4e-4104-4148-8847-78bf8e0a064d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:04.649210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:04.649846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:04.650129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:04.650430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] PATH_INFO: `/v3/users/ae9091eb1d47401ebfdf45a5260d2864` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:04.651659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9091eb1d47401ebfdf45a5260d2864)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:04.653725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:04.703444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9091eb1d47401ebfdf45a5260d2864'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:04.713817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9091eb1d47401ebfdf45a5260d2864'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:04.725872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9091eb1d47401ebfdf45a5260d2864'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:04.726515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9091eb1d47401ebfdf45a5260d2864'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:04.727147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9091eb1d47401ebfdf45a5260d2864'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:04.739757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1223/2453] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:33:04 2022] DELETE /identity/v3/users/ae9091eb1d47401ebfdf45a5260d2864 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:33:04.744350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:04.744864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:04.744864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:04.764461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:04.765666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:04.826674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1231/2454] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:33:04.836928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:04.838462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:04.845276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:04.917851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd42c1-c9e9-4262-8284-0128517fda87 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:04.924112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d5552-11c2-4563-b26c-40e8059a95dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:04.924756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5552-11c2-4563-b26c-40e8059a95dc service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:04.925022 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5552-11c2-4563-b26c-40e8059a95dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:04.925283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5552-11c2-4563-b26c-40e8059a95dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:04.940208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d5552-11c2-4563-b26c-40e8059a95dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:04.942419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d5552-11c2-4563-b26c-40e8059a95dc service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:04.955031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1224/2455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:33:05.135535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:05.137073 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:05.149053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574325-3e41-46c9-83d6-ce9bf71efc21 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:05.153713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:05.154346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:05.154621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:05.154908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] PATH_INFO: `/v3/projects/6fd8f8d6fc5e4c37bbc3c1fe2c694367` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:05.156035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd8f8d6fc5e4c37bbc3c1fe2c694367)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:05.157953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:05.205414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:05.209446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd8f8d6fc5e4c37bbc3c1fe2c694367', 'request_id': 'req-bc471df3-b272-470e-b5eb-eae624489507'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:05.215813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd8f8d6fc5e4c37bbc3c1fe2c694367', 'request_id': 'req-bc471df3-b272-470e-b5eb-eae624489507'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:05.223831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd8f8d6fc5e4c37bbc3c1fe2c694367', 'request_id': 'req-bc471df3-b272-470e-b5eb-eae624489507'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:05.234988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] The token cache is being invalidate because project 6fd8f8d6fc5e4c37bbc3c1fe2c694367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:33:05.235258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:05.235952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-bc471df3-b272-470e-b5eb-eae624489507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:33:05.237497 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1232/2456] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:33:05 2022] DELETE /identity/v3/projects/6fd8f8d6fc5e4c37bbc3c1fe2c694367 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:33:14.950506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=24 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:15.232163 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:27.785544 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7cc26-c01c-4093-9a4e-0258bce32d42 None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:27.786084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7cc26-c01c-4093-9a4e-0258bce32d42 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:27.786512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7cc26-c01c-4093-9a4e-0258bce32d42 None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:27.788134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1225/2457] 10.222.0.15 () {54 vars in 961 bytes} [Thu Sep 15 07:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:33:27.794059 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5232-3863-4ce5-a832-d5f290a34a9c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:27.794634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5232-3863-4ce5-a832-d5f290a34a9c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:27.794786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5232-3863-4ce5-a832-d5f290a34a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:27.817201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-539d5232-3863-4ce5-a832-d5f290a34a9c None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:27.818646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-539d5232-3863-4ce5-a832-d5f290a34a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:27.890044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1233/2458] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Sep 15 07:33:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:33:27.897012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7cc26-c01c-4093-9a4e-0258bce32d42 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:33:27.911578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7cc26-c01c-4093-9a4e-0258bce32d42 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:33:27.916897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd77b37-634b-428d-845c-fc85ab3aa339 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:33:27.917581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77b37-634b-428d-845c-fc85ab3aa339 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:27.917924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77b37-634b-428d-845c-fc85ab3aa339 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:27.918203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77b37-634b-428d-845c-fc85ab3aa339 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:27.920138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ddd77b37-634b-428d-845c-fc85ab3aa339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:27.932639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd77b37-634b-428d-845c-fc85ab3aa339 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:33:27.934264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd77b37-634b-428d-845c-fc85ab3aa339 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:33:27.944784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1226/2459] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:33:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:33:37.878534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=29 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:37.940202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:38.616142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28566a-ee96-4c27-97dc-0a30d0a0b691 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:38.616423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28566a-ee96-4c27-97dc-0a30d0a0b691 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:38.616722 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28566a-ee96-4c27-97dc-0a30d0a0b691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:38.637332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9b28566a-ee96-4c27-97dc-0a30d0a0b691 None None] MFA Rules not processed for user `0e421a45c825416fa5bf4aec29ed0c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:38.638556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9b28566a-ee96-4c27-97dc-0a30d0a0b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:38.695639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1234/2460] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:33:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:33:48.688481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=25 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:52.197716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:33:52.198351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:33:52.198351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:33:52.218123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] MFA Rules not processed for user `ea21235f22f14e6f8e9649c65f8a683f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:33:52.219383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:33:52.275016 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1227/2461] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:33:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:02.268485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=25 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:16.733332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:16.733837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:16.733944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:16.755505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:16.756751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:16.815297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1235/2462] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 15 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:16.863385 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:16.864882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:16.938689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736d742-3441-453f-9dda-eca887fe9858 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:16.944078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:16.944690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:16.944964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:16.945234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:16.953988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:16.955728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:16.963891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1228/2463] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:34:23.437696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:23.439365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:23.505654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ffd7d-f489-4f9e-90c1-39b505993750 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:23.511322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:23.511993 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:23.512273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:23.512514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] PATH_INFO: `/v3/users/ac8270c824de4344b6ad11acb48f6a6e` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:23.513763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8270c824de4344b6ad11acb48f6a6e)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:23.515824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:23.563694 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8270c824de4344b6ad11acb48f6a6e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.572264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8270c824de4344b6ad11acb48f6a6e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.572895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8270c824de4344b6ad11acb48f6a6e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.573540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8270c824de4344b6ad11acb48f6a6e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.583544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8270c824de4344b6ad11acb48f6a6e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.603365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1236/2464] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:34:23 2022] DELETE /identity/v3/users/ac8270c824de4344b6ad11acb48f6a6e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:34:23.785184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:23.798490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad8d92-7a8c-4a29-b710-e35bef8b1c6a service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:23.866007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:23.866654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:23.866968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:23.867239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] PATH_INFO: `/v3/projects/cd74c61af5e64661b1c2004e36806148` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:23.868453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd74c61af5e64661b1c2004e36806148)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:23.870379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:23.920172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd74c61af5e64661b1c2004e36806148', 'request_id': 'req-a4bd338a-b547-46f6-9240-26b4076eb0ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.930579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd74c61af5e64661b1c2004e36806148', 'request_id': 'req-a4bd338a-b547-46f6-9240-26b4076eb0ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.939550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd74c61af5e64661b1c2004e36806148', 'request_id': 'req-a4bd338a-b547-46f6-9240-26b4076eb0ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.956670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] The token cache is being invalidate because project cd74c61af5e64661b1c2004e36806148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:34:23.956971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.957716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:23.959419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1229/2465] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:34:23 2022] DELETE /identity/v3/projects/cd74c61af5e64661b1c2004e36806148 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:34:23.963960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:23.965572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:23.979831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39aca-cb38-4747-b187-dffb2c939926 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.002205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:24.043022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.043657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.043930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.044202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] PATH_INFO: `/v3/users/2a1fb1b3897146128e8c85806d95f62f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.045472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1fb1b3897146128e8c85806d95f62f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.047447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.096042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1fb1b3897146128e8c85806d95f62f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.104271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1fb1b3897146128e8c85806d95f62f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.104884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1fb1b3897146128e8c85806d95f62f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.105484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1fb1b3897146128e8c85806d95f62f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.112833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f712d00c-61b2-4204-9dd3-f8853566db2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1fb1b3897146128e8c85806d95f62f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.130235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1237/2466] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:34:23 2022] DELETE /identity/v3/users/2a1fb1b3897146128e8c85806d95f62f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:34:24.304718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:24.306189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:24.321471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd338a-b547-46f6-9240-26b4076eb0ed admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.341808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:24.383691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.384333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.384611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.384885 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] PATH_INFO: `/v3/projects/543865c55cf746c588995ee150a46262` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.386041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] RBAC: Authorizing `identity:delete_project(project_id=543865c55cf746c588995ee150a46262)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.388036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.438398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543865c55cf746c588995ee150a46262', 'request_id': 'req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.447317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543865c55cf746c588995ee150a46262', 'request_id': 'req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.453523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543865c55cf746c588995ee150a46262', 'request_id': 'req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.465375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] The token cache is being invalidate because project 543865c55cf746c588995ee150a46262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:34:24.465657 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.466433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7fbd0a5b-2713-4dae-9baa-6c68eabb232b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:34:24.467967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1230/2467] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:34:24 2022] DELETE /identity/v3/projects/543865c55cf746c588995ee150a46262 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:34:24.473446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c5a1-f356-4a6a-a295-fe357c01494b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.473930 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c5a1-f356-4a6a-a295-fe357c01494b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.474027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c5a1-f356-4a6a-a295-fe357c01494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.495045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e851c5a1-f356-4a6a-a295-fe357c01494b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:24.496242 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e851c5a1-f356-4a6a-a295-fe357c01494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:24.557699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1238/2468] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:34:24.565775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9816e-f479-405c-9b64-82226451c5d8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.566056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9816e-f479-405c-9b64-82226451c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.566328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9816e-f479-405c-9b64-82226451c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.587093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b5a9816e-f479-405c-9b64-82226451c5d8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:24.588310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b5a9816e-f479-405c-9b64-82226451c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:24.597041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1231/2469] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:24.601417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c5a1-f356-4a6a-a295-fe357c01494b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:24.611747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c5a1-f356-4a6a-a295-fe357c01494b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.616753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.617393 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.617656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.617923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.618577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:34:24.618922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.620544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.632878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1239/2470] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:34:24.637638 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9816e-f479-405c-9b64-82226451c5d8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:24.647362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9816e-f479-405c-9b64-82226451c5d8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.652922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.653524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.653798 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.654070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.654703 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.656671 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.686046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1232/2471] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:34:24 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:34:24.690477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:24.701356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2f84-2268-4b51-a90f-6517d6600d25 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.731077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:24.781413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.782031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.782303 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.782567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.783241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.785312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.812093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1240/2472] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:34:24 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:34:24.816619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:24.827447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c092-111b-4b0f-99b3-00fe05a19e24 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.832283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.832880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.833156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.833423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.834062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.835695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.845497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1233/2473] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:34:24.849629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:24.859987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbdff5-80f5-4cd7-b1e6-ec4889f7647b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.864998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e05de-ba91-41d1-bd22-62feaab47d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.865602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e05de-ba91-41d1-bd22-62feaab47d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.865879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e05de-ba91-41d1-bd22-62feaab47d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.866152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e05de-ba91-41d1-bd22-62feaab47d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.866802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e05de-ba91-41d1-bd22-62feaab47d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.868455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e05de-ba91-41d1-bd22-62feaab47d14 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.880387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1241/2474] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:34:24.884926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:24.900215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fa36-3410-451a-b648-745b09c0a490 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:24.907480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:24.908405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.908715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.909124 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] PATH_INFO: `/v3/projects/243a3746d7db4181b75f85e0e1f6b5e9/users/fe8048f110944a0683f8d41d3afdaa09/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.923748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243a3746d7db4181b75f85e0e1f6b5e9, user_id=fe8048f110944a0683f8d41d3afdaa09, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:24.926388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:24.940409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1234/2475] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:34:24 2022] PUT /identity/v3/projects/243a3746d7db4181b75f85e0e1f6b5e9/users/fe8048f110944a0683f8d41d3afdaa09/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:34:24.945986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb457c7-a868-4c52-94c3-35412dec3a38 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:24.946237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb457c7-a868-4c52-94c3-35412dec3a38 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:24.946500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb457c7-a868-4c52-94c3-35412dec3a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:24.966298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3cb457c7-a868-4c52-94c3-35412dec3a38 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:24.967538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3cb457c7-a868-4c52-94c3-35412dec3a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:25.037034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1242/2476] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:25.047601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:25.050515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:25.112223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:25.121553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39937c-e242-43ce-af97-768934b79fa4 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:25.127554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:25.128425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:25.128817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:25.129165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:25.143532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:25.145202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:25.154720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1235/2477] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:34:29.160746 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fe49-e2b6-423d-9fe1-e436f36538f1 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:29.161320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fe49-e2b6-423d-9fe1-e436f36538f1 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:29.161320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86fe49-e2b6-423d-9fe1-e436f36538f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:29.192682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8f86fe49-e2b6-423d-9fe1-e436f36538f1 None None] MFA Rules not processed for user `fe8048f110944a0683f8d41d3afdaa09`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:29.194358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8f86fe49-e2b6-423d-9fe1-e436f36538f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:29.264680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1243/2478] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:29.269323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:29.279282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7443f0-6097-4f91-a3e2-1c3cb11b0bfa service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:29.284059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:29.284748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:29.285023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:29.285290 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:29.285935 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:29.287884 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:29.317187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1236/2479] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:34:29 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:34:29.321471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86fe49-e2b6-423d-9fe1-e436f36538f1 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:29.333511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86fe49-e2b6-423d-9fe1-e436f36538f1 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:29.375954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:29.395038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:29.395683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:29.395959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:29.396230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:29.396879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:29.398918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:29.421699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1244/2480] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:34:29 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:34:29.425786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:29.437096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d2e71-ab28-41ac-a0cf-6b7290d40b07 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:29.441772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:29.442395 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:29.442672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:29.442986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:29.443636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:29.445275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:29.456833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1237/2481] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:34:29.461084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:29.472464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd53b4-72e3-403f-bc59-9cd1cd0d413b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:29.478133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:29.478752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:29.479088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:29.479347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] PATH_INFO: `/v3/projects/520f4dfc8a004ea0bb0adb524c8a87dd/users/e6147f96ddfe414895cba8567b7c6026/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:29.496137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=520f4dfc8a004ea0bb0adb524c8a87dd, user_id=e6147f96ddfe414895cba8567b7c6026, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:29.498981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:29.513558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1245/2482] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:34:29 2022] PUT /identity/v3/projects/520f4dfc8a004ea0bb0adb524c8a87dd/users/e6147f96ddfe414895cba8567b7c6026/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:34:29.517635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:29.528093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d50d96-2a83-4530-9dfc-f66690b34d23 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:29.586713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98970f-62b4-4dc5-b13d-59bf74e1d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:29.587492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98970f-62b4-4dc5-b13d-59bf74e1d0da admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:29.587770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98970f-62b4-4dc5-b13d-59bf74e1d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:29.588042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98970f-62b4-4dc5-b13d-59bf74e1d0da admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:29.588705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98970f-62b4-4dc5-b13d-59bf74e1d0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:29.590310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98970f-62b4-4dc5-b13d-59bf74e1d0da admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:29.605018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1238/2483] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:34:29.606192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:29.626139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ec191-8e9e-4d88-8cc2-7f4f635bbccf admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:29.632775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4469-7066-40ff-860f-cac069f4cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:29.633598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4469-7066-40ff-860f-cac069f4cd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:29.633956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4469-7066-40ff-860f-cac069f4cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:29.634359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4469-7066-40ff-860f-cac069f4cd93 admin admin] PATH_INFO: `/v3/projects/520f4dfc8a004ea0bb0adb524c8a87dd/users/e6147f96ddfe414895cba8567b7c6026/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:29.636496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c4469-7066-40ff-860f-cac069f4cd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520f4dfc8a004ea0bb0adb524c8a87dd, user_id=e6147f96ddfe414895cba8567b7c6026, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:29.639259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c4469-7066-40ff-860f-cac069f4cd93 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:29.650661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1246/2484] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:34:29 2022] PUT /identity/v3/projects/520f4dfc8a004ea0bb0adb524c8a87dd/users/e6147f96ddfe414895cba8567b7c6026/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:34:35.585430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:35.586481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:35.587011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:35.674199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] MFA Rules not processed for user `c0cb3d32205b485eb96d1de3f5e0749f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:35.675614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:35.819386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1239/2485] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:35.895975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131dd51-32c3-4c14-bf40-3978ebeda519 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:35.896388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131dd51-32c3-4c14-bf40-3978ebeda519 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:35.896624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131dd51-32c3-4c14-bf40-3978ebeda519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:35.946789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b131dd51-32c3-4c14-bf40-3978ebeda519 None None] MFA Rules not processed for user `e6147f96ddfe414895cba8567b7c6026`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:35.961691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b131dd51-32c3-4c14-bf40-3978ebeda519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:36.090410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1247/2486] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:36.110364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:34:36.111924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:36.179917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:36.204783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601ec96-bfcd-4c2b-aa7f-1d60d6913173 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:34:36.210480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78484f26-1d97-4f45-a08e-87344b54b7a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:34:36.211147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78484f26-1d97-4f45-a08e-87344b54b7a1 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:36.211424 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78484f26-1d97-4f45-a08e-87344b54b7a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:36.211698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78484f26-1d97-4f45-a08e-87344b54b7a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:36.303408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78484f26-1d97-4f45-a08e-87344b54b7a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:34:36.305032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78484f26-1d97-4f45-a08e-87344b54b7a1 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:34:36.317999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1240/2487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:34:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:34:37.734903 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1994-c20d-475a-b49f-96787a52660b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:37.735476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1994-c20d-475a-b49f-96787a52660b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:37.735476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1994-c20d-475a-b49f-96787a52660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:37.758603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-525d1994-c20d-475a-b49f-96787a52660b None None] MFA Rules not processed for user `fe8048f110944a0683f8d41d3afdaa09`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:37.760285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-525d1994-c20d-475a-b49f-96787a52660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:37.774178 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1248/2488] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:34:46.310282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=30 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:47.757362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:34:53.481545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf194fb-ac7a-46fa-8d0f-cfd8e848cb23 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:34:53.482010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf194fb-ac7a-46fa-8d0f-cfd8e848cb23 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:34:53.482091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf194fb-ac7a-46fa-8d0f-cfd8e848cb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:34:53.506582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1bf194fb-ac7a-46fa-8d0f-cfd8e848cb23 None None] MFA Rules not processed for user `0e421a45c825416fa5bf4aec29ed0c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:34:53.507824 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1bf194fb-ac7a-46fa-8d0f-cfd8e848cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:34:53.572891 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1241/2489] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:34:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:03.371846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1994-c20d-475a-b49f-96787a52660b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:03.373226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-525d1994-c20d-475a-b49f-96787a52660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:03.462024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1994-c20d-475a-b49f-96787a52660b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:03.468945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:03.470307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:03.471159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:03.472079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] PATH_INFO: `/v3/users/ea21235f22f14e6f8e9649c65f8a683f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:03.474752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea21235f22f14e6f8e9649c65f8a683f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:03.478628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:03.544187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea21235f22f14e6f8e9649c65f8a683f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.558341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea21235f22f14e6f8e9649c65f8a683f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.559153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea21235f22f14e6f8e9649c65f8a683f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.559784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea21235f22f14e6f8e9649c65f8a683f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.563354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=25 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:03.569774 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b601bdb8-1042-4892-b3d5-a22a77c1a0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea21235f22f14e6f8e9649c65f8a683f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.589389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1249/2490] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:35:03 2022] DELETE /identity/v3/users/ea21235f22f14e6f8e9649c65f8a683f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:03.778499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf194fb-ac7a-46fa-8d0f-cfd8e848cb23 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:03.790545 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf194fb-ac7a-46fa-8d0f-cfd8e848cb23 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:03.860167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:03.860985 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:03.861351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:03.861691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] PATH_INFO: `/v3/projects/7345dbd2abc44a009ecd2093e79bdb01` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:03.862918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7345dbd2abc44a009ecd2093e79bdb01)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:03.864961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:03.914739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7345dbd2abc44a009ecd2093e79bdb01', 'request_id': 'req-a4505d49-166a-4e22-b886-0c19f73fde51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.924327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7345dbd2abc44a009ecd2093e79bdb01', 'request_id': 'req-a4505d49-166a-4e22-b886-0c19f73fde51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.930029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7345dbd2abc44a009ecd2093e79bdb01', 'request_id': 'req-a4505d49-166a-4e22-b886-0c19f73fde51'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.941195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] The token cache is being invalidate because project 7345dbd2abc44a009ecd2093e79bdb01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:35:03.941479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.942163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a4505d49-166a-4e22-b886-0c19f73fde51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:03.943738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1242/2491] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:35:03 2022] DELETE /identity/v3/projects/7345dbd2abc44a009ecd2093e79bdb01 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:03.949347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fa010-4d1f-4aef-b18b-1ced50c90074 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:03.949807 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fa010-4d1f-4aef-b18b-1ced50c90074 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:03.950074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fa010-4d1f-4aef-b18b-1ced50c90074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:03.971741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-aa9fa010-4d1f-4aef-b18b-1ced50c90074 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:03.972943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-aa9fa010-4d1f-4aef-b18b-1ced50c90074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:04.039567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1250/2492] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:04.050656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad2b2-f87e-4368-9105-d846282c03e4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.050978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad2b2-f87e-4368-9105-d846282c03e4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.051250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ad2b2-f87e-4368-9105-d846282c03e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.072562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c84ad2b2-f87e-4368-9105-d846282c03e4 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:04.074151 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c84ad2b2-f87e-4368-9105-d846282c03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:04.083207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1243/2493] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:04.087758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fa010-4d1f-4aef-b18b-1ced50c90074 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:04.098100 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fa010-4d1f-4aef-b18b-1ced50c90074 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:04.104272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:04.104874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.105149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.105413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.106062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:35:04.106358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:04.108027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:04.121886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1251/2494] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:35:04.126321 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ad2b2-f87e-4368-9105-d846282c03e4 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:04.135841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ad2b2-f87e-4368-9105-d846282c03e4 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:04.141277 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:04.141876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.142156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.142421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.143076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:04.144970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:04.176584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1244/2495] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:35:04 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:04.180838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:04.190804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50152-e002-40ff-8159-b21a1e702a57 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:04.194558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:04.250102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:04.250749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.251067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.251336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.251982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:04.253974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:04.277660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1252/2496] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:35:04 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:04.282060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:04.292494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e3502-9bd5-4ca4-b11c-054c2792e0a7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:04.297948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:04.298552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.298851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.299123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.299768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:04.301367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:04.311829 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1245/2497] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:35:04.315777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:04.326416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4b44-b274-46ee-aaa1-9e09f0036a05 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:04.331883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e376102-18e4-4ad7-849c-a117afa9b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:04.332475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e376102-18e4-4ad7-849c-a117afa9b99c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.332752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e376102-18e4-4ad7-849c-a117afa9b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.333021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e376102-18e4-4ad7-849c-a117afa9b99c admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.333778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e376102-18e4-4ad7-849c-a117afa9b99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:04.335404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e376102-18e4-4ad7-849c-a117afa9b99c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:04.346626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1253/2498] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:04.350837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:04.361767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e982b-044b-4079-87f9-a068b20d477f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:04.367690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:04.368344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.368624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.368876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] PATH_INFO: `/v3/projects/eb86744c38c149caa782881e8689f2f5/users/97c3c6f420da4209aa68ec0c8c3c543f/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.384197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb86744c38c149caa782881e8689f2f5, user_id=97c3c6f420da4209aa68ec0c8c3c543f, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:04.386906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:04.401070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1246/2499] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:35:04 2022] PUT /identity/v3/projects/eb86744c38c149caa782881e8689f2f5/users/97c3c6f420da4209aa68ec0c8c3c543f/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:04.406253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.406738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.406859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.425844 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:04.427084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:04.489421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1254/2500] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:04.501276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:04.501906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:04.537510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:04.569529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46b918-5c74-4daf-8dc9-57436cae6edf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:04.573747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808a654-6cff-4ac2-9d72-f2d0a4f000a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:04.574363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808a654-6cff-4ac2-9d72-f2d0a4f000a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:04.574637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808a654-6cff-4ac2-9d72-f2d0a4f000a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:04.574939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808a654-6cff-4ac2-9d72-f2d0a4f000a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:04.584936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808a654-6cff-4ac2-9d72-f2d0a4f000a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:04.586391 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808a654-6cff-4ac2-9d72-f2d0a4f000a4 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:04.596466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1247/2501] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:07.809871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:07.811380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:07.836062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a018b01-15c0-4564-acd1-da71c8683bb0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:07.845042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:07.845685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:07.846266 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:07.846543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:07.848954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:07.938220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:07.939755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:07.955220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1255/2502] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:09.624251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfb28-773e-4fe7-9d09-af991d2527c2 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:09.625211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfb28-773e-4fe7-9d09-af991d2527c2 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:09.625681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfb28-773e-4fe7-9d09-af991d2527c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:09.668661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c63dfb28-773e-4fe7-9d09-af991d2527c2 None None] MFA Rules not processed for user `97c3c6f420da4209aa68ec0c8c3c543f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:09.670138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c63dfb28-773e-4fe7-9d09-af991d2527c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:09.785457 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1248/2503] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:09.801176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:09.802751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:09.839788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:09.921449 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4d685-476b-4b86-87d1-6ae66decdb3c service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:09.927396 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:09.928070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:09.928350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:09.928621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:09.937194 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:09.938916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:09.953588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1256/2504] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:12.520289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7f29-501d-4174-a0db-4e9b09daf062 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:12.520915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7f29-501d-4174-a0db-4e9b09daf062 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:12.521637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7f29-501d-4174-a0db-4e9b09daf062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:12.551139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2aef7f29-501d-4174-a0db-4e9b09daf062 None None] MFA Rules not processed for user `97c3c6f420da4209aa68ec0c8c3c543f`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:12.554623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2aef7f29-501d-4174-a0db-4e9b09daf062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:12.574494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1249/2505] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:18.346128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:18.355801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dc21a-f8e4-4c8a-8538-0101561f28c3 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:18.359765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:18.360360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:18.360628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:18.360912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:18.362714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:18.376255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:18.377676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:18.389044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1257/2506] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:19.583958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef7f29-501d-4174-a0db-4e9b09daf062 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:19.594763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef7f29-501d-4174-a0db-4e9b09daf062 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:19.599470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:19.600076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:19.600349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:19.600626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:19.602770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:19.617073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:19.618510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:19.630089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1250/2507] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:28.383958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=31 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:29.625181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=55 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:38.752833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:38.754680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:38.818001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37232-3d32-43e5-a8a2-1e8f65270c78 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:38.822408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81b3a-eab8-43a5-892a-943f912cb465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:38.823428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81b3a-eab8-43a5-892a-943f912cb465 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:38.823725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81b3a-eab8-43a5-892a-943f912cb465 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:38.823994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81b3a-eab8-43a5-892a-943f912cb465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:38.826340 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a3c81b3a-eab8-43a5-892a-943f912cb465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:38.887983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81b3a-eab8-43a5-892a-943f912cb465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:38.889799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81b3a-eab8-43a5-892a-943f912cb465 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:38.898637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1258/2508] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:48.894548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=48 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:51.524901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:51.534309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6811ada-3526-4adc-b32b-fd468d262368 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:51.538864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2eeb5-2fbd-4285-9d79-cc861552d5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:51.539490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eeb5-2fbd-4285-9d79-cc861552d5af service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:51.539764 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eeb5-2fbd-4285-9d79-cc861552d5af service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:51.540028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eeb5-2fbd-4285-9d79-cc861552d5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:51.542015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-11f2eeb5-2fbd-4285-9d79-cc861552d5af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:51.554236 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2eeb5-2fbd-4285-9d79-cc861552d5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:51.555688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2eeb5-2fbd-4285-9d79-cc861552d5af service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:51.565546 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1251/2509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:54.652055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e1ae8-b46e-4ec9-9b8d-8a219488e883 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:54.652506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e1ae8-b46e-4ec9-9b8d-8a219488e883 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:54.652600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e1ae8-b46e-4ec9-9b8d-8a219488e883 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:54.653888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1259/2510] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:35:54.665092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:54.665588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:54.665706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:54.685122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] MFA Rules not processed for user `7cd8870330414fddaca7b5d2075b4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:54.686329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:54.727943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e1ae8-b46e-4ec9-9b8d-8a219488e883 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:54.729764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d26e1ae8-b46e-4ec9-9b8d-8a219488e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:54.749198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e1ae8-b46e-4ec9-9b8d-8a219488e883 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:54.753889 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:54.754621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:54.755141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:54.755515 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] PATH_INFO: `/v3/users/c0cb3d32205b485eb96d1de3f5e0749f` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:54.756701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cb3d32205b485eb96d1de3f5e0749f)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:54.758713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:54.761041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1252/2511] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:35:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:54.772525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:54.773903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:54.787193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9380744-df13-4541-bc0c-9e2dd91ee6c3 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:54.792909 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:54.793666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:54.794002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:54.794307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:54.807451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cb3d32205b485eb96d1de3f5e0749f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:54.808988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:54.810679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:54.816448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cb3d32205b485eb96d1de3f5e0749f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:54.817235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cb3d32205b485eb96d1de3f5e0749f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:54.817995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cb3d32205b485eb96d1de3f5e0749f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:54.821386 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1253/2512] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:54.825829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a7292278-14b9-4743-b67b-ba8d8a568bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cb3d32205b485eb96d1de3f5e0749f'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:54.844358 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1260/2513] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:35:54 2022] DELETE /identity/v3/users/c0cb3d32205b485eb96d1de3f5e0749f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:55.014603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.027111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50aa3e4-7676-4948-ab93-07de982ca761 service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.085765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.086400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.086674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.086974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] PATH_INFO: `/v3/projects/c1c57261914d45dfa480bfa3dda25cf2` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.088101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c57261914d45dfa480bfa3dda25cf2)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.090025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.140249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c57261914d45dfa480bfa3dda25cf2', 'request_id': 'req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:55.149186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c57261914d45dfa480bfa3dda25cf2', 'request_id': 'req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:55.155002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c57261914d45dfa480bfa3dda25cf2', 'request_id': 'req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:55.162630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:55.167109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] The token cache is being invalidate because project c1c57261914d45dfa480bfa3dda25cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:35:55.167617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:55.168618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-290fc1ef-9f3c-4dda-975b-0ac77f44cb6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:55.170301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1254/2514] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:35:55 2022] DELETE /identity/v3/projects/c1c57261914d45dfa480bfa3dda25cf2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:55.175604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb831fc-a76a-446f-abd2-42bb43492f8b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.175916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb831fc-a76a-446f-abd2-42bb43492f8b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.176190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb831fc-a76a-446f-abd2-42bb43492f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.200264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-feb831fc-a76a-446f-abd2-42bb43492f8b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:55.201758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-feb831fc-a76a-446f-abd2-42bb43492f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:55.272775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1261/2515] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:55.281643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383adf67-9b55-4aa6-b089-be57f4011e2d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.281950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383adf67-9b55-4aa6-b089-be57f4011e2d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.282314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383adf67-9b55-4aa6-b089-be57f4011e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.302500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-383adf67-9b55-4aa6-b089-be57f4011e2d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:55.303749 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-383adf67-9b55-4aa6-b089-be57f4011e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:55.312579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1255/2516] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:55.317121 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb831fc-a76a-446f-abd2-42bb43492f8b None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.327354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb831fc-a76a-446f-abd2-42bb43492f8b None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.332460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.333056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.333330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.333600 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.334240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:35:55.334537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.336193 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.347609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1262/2517] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:35:55.352025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383adf67-9b55-4aa6-b089-be57f4011e2d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.361503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383adf67-9b55-4aa6-b089-be57f4011e2d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.366660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.367296 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.367573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.367843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.368479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.370379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.399064 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1256/2518] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:35:55 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:55.403233 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.413486 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8bec0-7005-4358-8545-05bf59089a76 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.473682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.474300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.474574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.474862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.475507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.477494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.485371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:55.502020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1263/2519] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:35:55 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:55.506377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.517147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97887624-ea39-4711-a821-8e8683016b37 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.523474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.524088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.524365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.524637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.525279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.526922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.537351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1257/2520] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:55.542011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.553909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b584b2-cb7c-471e-a142-423745789fe5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.561187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f9c37-10ee-4cf5-9535-76174cc00d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.562090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f9c37-10ee-4cf5-9535-76174cc00d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.562471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f9c37-10ee-4cf5-9535-76174cc00d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.562878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f9c37-10ee-4cf5-9535-76174cc00d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.563820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f9c37-10ee-4cf5-9535-76174cc00d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.566196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f9c37-10ee-4cf5-9535-76174cc00d15 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.581740 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1264/2521] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:55.586318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.596627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d0ab-f7ea-4c61-af21-b82773325fa5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.602279 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.602977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.603254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.603525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] PATH_INFO: `/v3/projects/5058b9301add40afbaaaf28768324646/users/6c544af28d9843d49dbeef417e3568ba/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.621266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5058b9301add40afbaaaf28768324646, user_id=6c544af28d9843d49dbeef417e3568ba, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.624119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.639495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1258/2522] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:35:55 2022] PUT /identity/v3/projects/5058b9301add40afbaaaf28768324646/users/6c544af28d9843d49dbeef417e3568ba/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:55.651324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbda49-d306-4702-b17b-15b6d74d392f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.651582 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbda49-d306-4702-b17b-15b6d74d392f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.651851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbda49-d306-4702-b17b-15b6d74d392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.680540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-75bbda49-d306-4702-b17b-15b6d74d392f None None] MFA Rules not processed for user `6c544af28d9843d49dbeef417e3568ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:55.681739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-75bbda49-d306-4702-b17b-15b6d74d392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:55.748329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1265/2523] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:55.753103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.817797 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8882d2-5d6a-4266-b57c-1a80e23f078d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.823291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.823907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.824183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.824453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.825083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.827014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.857903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1259/2524] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:35:55 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:55.859103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbda49-d306-4702-b17b-15b6d74d392f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.870161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbda49-d306-4702-b17b-15b6d74d392f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.926004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.926538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.926815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.927138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.927767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.929710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.953737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1266/2525] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:35:55 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:55.959726 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:55.973487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f1aa1-f20d-41b6-a58e-a8d033653f55 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:55.978606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:55.979233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:55.979508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:55.979777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:55.980412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:55.982002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:55.993192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1260/2526] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:55.997760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:56.009261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e68d-609a-44ef-98ce-54d9cc1b311e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:56.014861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:56.015531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.015839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.016111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] PATH_INFO: `/v3/projects/4caecbaeb8934c00931d27c78bbe9f70/users/eae420aca1854253b1f14c062e4b35ff/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.031343 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4caecbaeb8934c00931d27c78bbe9f70, user_id=eae420aca1854253b1f14c062e4b35ff, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:56.034153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:56.049567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1267/2527] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:35:55 2022] PUT /identity/v3/projects/4caecbaeb8934c00931d27c78bbe9f70/users/eae420aca1854253b1f14c062e4b35ff/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:56.054413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:56.067622 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa81eb4-e4e6-4c28-83f2-36622ccd24ab admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:56.128463 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98a719-c9fb-4818-b948-6990a24edf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:56.129101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98a719-c9fb-4818-b948-6990a24edf70 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.129379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98a719-c9fb-4818-b948-6990a24edf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.129632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98a719-c9fb-4818-b948-6990a24edf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.130262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98a719-c9fb-4818-b948-6990a24edf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:56.131904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98a719-c9fb-4818-b948-6990a24edf70 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:56.141989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1261/2528] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:35:56.146419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:56.156936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd44b8-501f-4395-a429-dd4bae691762 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:56.162310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:56.163190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.163469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.163854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] PATH_INFO: `/v3/projects/4caecbaeb8934c00931d27c78bbe9f70/users/eae420aca1854253b1f14c062e4b35ff/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.166065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4caecbaeb8934c00931d27c78bbe9f70, user_id=eae420aca1854253b1f14c062e4b35ff, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:56.168854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:56.180013 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1268/2529] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:35:56 2022] PUT /identity/v3/projects/4caecbaeb8934c00931d27c78bbe9f70/users/eae420aca1854253b1f14c062e4b35ff/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:56.191347 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945e2e-5f9c-4434-9837-4501f8057591 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.191695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945e2e-5f9c-4434-9837-4501f8057591 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.192077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945e2e-5f9c-4434-9837-4501f8057591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.214077 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:56.230323 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-87945e2e-5f9c-4434-9837-4501f8057591 None None] MFA Rules not processed for user `eae420aca1854253b1f14c062e4b35ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:56.231597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-87945e2e-5f9c-4434-9837-4501f8057591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:56.307357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1262/2530] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:56.318649 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:56.320816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:56.344370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:56.381592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56204d6-df9c-4097-ab3b-38ec9c79bf19 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:56.385787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08739d0c-70e3-4557-a8f0-2714daf62714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:56.386386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08739d0c-70e3-4557-a8f0-2714daf62714 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.386654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08739d0c-70e3-4557-a8f0-2714daf62714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.386952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08739d0c-70e3-4557-a8f0-2714daf62714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.396383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08739d0c-70e3-4557-a8f0-2714daf62714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:56.397818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08739d0c-70e3-4557-a8f0-2714daf62714 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:56.407298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1269/2531] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:56 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:56.552516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87945e2e-5f9c-4434-9837-4501f8057591 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:56.625846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87945e2e-5f9c-4434-9837-4501f8057591 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:56.632160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:56.632811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.633092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.633362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] PATH_INFO: `/v3/users/6c544af28d9843d49dbeef417e3568ba` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.634769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c544af28d9843d49dbeef417e3568ba)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:56.636811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:56.685636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c544af28d9843d49dbeef417e3568ba'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:56.695742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c544af28d9843d49dbeef417e3568ba'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:56.707818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c544af28d9843d49dbeef417e3568ba'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:56.708447 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c544af28d9843d49dbeef417e3568ba'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:56.709142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c544af28d9843d49dbeef417e3568ba'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:56.722683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1263/2532] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:35:56 2022] DELETE /identity/v3/users/6c544af28d9843d49dbeef417e3568ba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:56.727772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.728274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.728274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.748226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:56.749628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:56.816136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1270/2533] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:56.826329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:56.827776 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:56.842211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:56.895311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037ceb-20e7-4ed0-8245-b75b0672d4be admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:56.899052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:56.899661 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:56.899966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:56.900231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:56.913685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:56.915182 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:56.925882 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1264/2534] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:57.157257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:57.158983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:57.210525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:57.212192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:57.232708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fdb4-0ff1-40c0-ad0c-bc54c0e8d249 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:57.239945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeb254-dca1-4243-afa5-98c089288420 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:57.240763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:57.241422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:57.241819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:57.241993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] PATH_INFO: `/v3/projects/5058b9301add40afbaaaf28768324646` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:57.243149 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5058b9301add40afbaaaf28768324646)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:57.245165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:57.245828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:57.246469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:57.246736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:57.247115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:57.249646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:57.296786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5058b9301add40afbaaaf28768324646', 'request_id': 'req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.304954 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5058b9301add40afbaaaf28768324646', 'request_id': 'req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.311451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5058b9301add40afbaaaf28768324646', 'request_id': 'req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.327196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:57.327415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] The token cache is being invalidate because project 5058b9301add40afbaaaf28768324646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:35:57.327542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.328169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.328937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:57.329777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1265/2535] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:35:57 2022] DELETE /identity/v3/projects/5058b9301add40afbaaaf28768324646 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:57.333706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:57.333862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:57.335161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:57.339566 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1271/2536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:57.403264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0189-73ab-43b3-9d6e-f20fe38e9fa1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:57.408267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:57.408900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:57.409177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:57.409443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] PATH_INFO: `/v3/users/eae420aca1854253b1f14c062e4b35ff` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:57.410649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae420aca1854253b1f14c062e4b35ff)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:57.412604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:57.455154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:57.462038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae420aca1854253b1f14c062e4b35ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.471317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae420aca1854253b1f14c062e4b35ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.483368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae420aca1854253b1f14c062e4b35ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.484023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae420aca1854253b1f14c062e4b35ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.484631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-057b7433-e35e-4ce2-99d8-d4eddce72fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae420aca1854253b1f14c062e4b35ff'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.499002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1266/2537] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:35:57 2022] DELETE /identity/v3/users/eae420aca1854253b1f14c062e4b35ff => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:35:57.792268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:57.803484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8ca9-3188-4055-b2e3-7b8ef75e2ad1 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:57.863539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:57.864453 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:57.864763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:57.865044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] PATH_INFO: `/v3/projects/4caecbaeb8934c00931d27c78bbe9f70` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:57.866265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4caecbaeb8934c00931d27c78bbe9f70)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:57.868335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:57.917456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4caecbaeb8934c00931d27c78bbe9f70', 'request_id': 'req-88ee1961-185e-4e30-b630-29e4c40ed3b0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.923703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4caecbaeb8934c00931d27c78bbe9f70', 'request_id': 'req-88ee1961-185e-4e30-b630-29e4c40ed3b0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.931887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4caecbaeb8934c00931d27c78bbe9f70', 'request_id': 'req-88ee1961-185e-4e30-b630-29e4c40ed3b0'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.942900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] The token cache is being invalidate because project 4caecbaeb8934c00931d27c78bbe9f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:35:57.943221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.943940 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-88ee1961-185e-4e30-b630-29e4c40ed3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:35:57.945596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1272/2538] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:35:57 2022] DELETE /identity/v3/projects/4caecbaeb8934c00931d27c78bbe9f70 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:57.951123 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7f1a3-2402-46b6-a271-37b056a6882d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:57.951597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7f1a3-2402-46b6-a271-37b056a6882d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:57.951712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7f1a3-2402-46b6-a271-37b056a6882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:57.973469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1ee7f1a3-2402-46b6-a271-37b056a6882d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:57.974614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1ee7f1a3-2402-46b6-a271-37b056a6882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:58.037613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1267/2539] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:35:58.045776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ea75-baa6-4e6c-8b0b-3f664c04dad0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.046079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ea75-baa6-4e6c-8b0b-3f664c04dad0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.046346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ea75-baa6-4e6c-8b0b-3f664c04dad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.068699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4f41ea75-baa6-4e6c-8b0b-3f664c04dad0 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:58.069942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4f41ea75-baa6-4e6c-8b0b-3f664c04dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:58.079161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1273/2540] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:58.083681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7f1a3-2402-46b6-a271-37b056a6882d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.093739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7f1a3-2402-46b6-a271-37b056a6882d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.099313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.099914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.100194 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.100460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.101113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:35:58.101412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.103291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.114970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1268/2541] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:35:58.119439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41ea75-baa6-4e6c-8b0b-3f664c04dad0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.129139 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41ea75-baa6-4e6c-8b0b-3f664c04dad0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.134875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.135495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.135770 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.136035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.136672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.138636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.169403 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1274/2542] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:35:58 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:58.175807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.190073 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ed17-52dd-47e3-963f-83ff774cac91 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.248214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.248740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.249018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.249288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.249893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.251999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.277506 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1269/2543] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:35:58 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:58.282187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.292462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a199-b9f1-45eb-83aa-b32a4fe85ae9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.297563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.298159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.298433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.298699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.299361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.300962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.311080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1275/2544] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:58.315213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.326106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5b24-32e7-4433-bbdd-ee52bcc58b23 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.332134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71032e-1df8-4f45-80fe-d34ceac1950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.332747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71032e-1df8-4f45-80fe-d34ceac1950c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.333019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71032e-1df8-4f45-80fe-d34ceac1950c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.333287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71032e-1df8-4f45-80fe-d34ceac1950c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.333939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71032e-1df8-4f45-80fe-d34ceac1950c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.335596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71032e-1df8-4f45-80fe-d34ceac1950c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.347121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1270/2545] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:58.351505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.361758 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40af171-44b8-43bb-9e24-15a96359eaae admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.366648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.367339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.367606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.367874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] PATH_INFO: `/v3/projects/8b0c12514db84302983acc080bbba691/users/17ecf5ac54534d94bb337411928920ed/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.382847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0c12514db84302983acc080bbba691, user_id=17ecf5ac54534d94bb337411928920ed, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.385558 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.399330 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1276/2546] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:35:58 2022] PUT /identity/v3/projects/8b0c12514db84302983acc080bbba691/users/17ecf5ac54534d94bb337411928920ed/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:58.411098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614af5-0cd0-4d97-89b4-fa6c8bcf0a72 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.411383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614af5-0cd0-4d97-89b4-fa6c8bcf0a72 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.411655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4614af5-0cd0-4d97-89b4-fa6c8bcf0a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.444261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-f4614af5-0cd0-4d97-89b4-fa6c8bcf0a72 None None] MFA Rules not processed for user `17ecf5ac54534d94bb337411928920ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:58.445500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-f4614af5-0cd0-4d97-89b4-fa6c8bcf0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:58.455707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:58.512315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1271/2547] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:58.518645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.549196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:58.583565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908686-3553-4b00-80b5-2237113d9013 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.588529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.589136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.589411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.589686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.590314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.592275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.622711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1277/2548] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:35:58 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:58.626616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4614af5-0cd0-4d97-89b4-fa6c8bcf0a72 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.638346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4614af5-0cd0-4d97-89b4-fa6c8bcf0a72 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.696162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.696777 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.697437 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.697708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.698375 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.700319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.723147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1272/2549] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:35:58 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:35:58.727016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.737713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cd548-96df-467a-8e49-8326c113278a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.742632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.743295 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.743572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.743843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.744520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.746190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.757153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1278/2550] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:58.761552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.772429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28a9a2-cfaa-4010-adc6-f122a358b2be admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.777334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.778002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.778278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.778547 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] PATH_INFO: `/v3/projects/fb9987935d0b4d7d93d106e614e3e6be/users/d816d3c7dbce4fa9af876c5450a85748/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.795446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9987935d0b4d7d93d106e614e3e6be, user_id=d816d3c7dbce4fa9af876c5450a85748, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.798334 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.813109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1273/2551] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:35:58 2022] PUT /identity/v3/projects/fb9987935d0b4d7d93d106e614e3e6be/users/d816d3c7dbce4fa9af876c5450a85748/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:58.817296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.827878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2686f46-3673-4e2f-b510-6f774deede41 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.889802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fbadd-cb16-4d82-a21e-a54d677a9c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.890478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fbadd-cb16-4d82-a21e-a54d677a9c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.890779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fbadd-cb16-4d82-a21e-a54d677a9c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.891110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fbadd-cb16-4d82-a21e-a54d677a9c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.891822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fbadd-cb16-4d82-a21e-a54d677a9c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.893464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fbadd-cb16-4d82-a21e-a54d677a9c11 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.904556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1279/2552] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:35:58.908717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:58.919481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424966a-4a59-4044-a412-176d36f9e48d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:58.924273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:58.924926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.925204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.925476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] PATH_INFO: `/v3/projects/fb9987935d0b4d7d93d106e614e3e6be/users/d816d3c7dbce4fa9af876c5450a85748/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.927466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9987935d0b4d7d93d106e614e3e6be, user_id=d816d3c7dbce4fa9af876c5450a85748, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:58.930114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:58.942087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1274/2553] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:35:58 2022] PUT /identity/v3/projects/fb9987935d0b4d7d93d106e614e3e6be/users/d816d3c7dbce4fa9af876c5450a85748/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:35:58.953352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45131aa-d1d3-4246-b109-25f52f98ef5c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:58.953634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45131aa-d1d3-4246-b109-25f52f98ef5c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:58.953905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45131aa-d1d3-4246-b109-25f52f98ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:58.984465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-b45131aa-d1d3-4246-b109-25f52f98ef5c None None] MFA Rules not processed for user `d816d3c7dbce4fa9af876c5450a85748`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:35:58.985681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-b45131aa-d1d3-4246-b109-25f52f98ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:59.068259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1280/2554] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:35:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:35:59.080609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:59.082981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:35:59.141092 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2ef8a-f5b0-477f-8fe5-efd9f86f7029 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:59.144849 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:59.145478 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:59.145748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:59.146012 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:59.155794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:59.157240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:59.167647 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1275/2555] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:35:59.215324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45131aa-d1d3-4246-b109-25f52f98ef5c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:35:59.227275 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45131aa-d1d3-4246-b109-25f52f98ef5c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:35:59.232976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df362e-e67f-4bdf-aebc-9f8396a0d0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:35:59.233805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df362e-e67f-4bdf-aebc-9f8396a0d0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:35:59.234205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df362e-e67f-4bdf-aebc-9f8396a0d0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:35:59.234583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df362e-e67f-4bdf-aebc-9f8396a0d0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:35:59.257198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:35:59.298459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df362e-e67f-4bdf-aebc-9f8396a0d0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:35:59.300000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df362e-e67f-4bdf-aebc-9f8396a0d0d2 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:35:59.309232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1281/2556] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:35:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:02.803827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:02.812763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:02.871120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5086-57c9-4736-8714-79cb7abbca42 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:02.875794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:02.876436 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:02.876717 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:02.876987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] PATH_INFO: `/v3/users/17ecf5ac54534d94bb337411928920ed` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:02.878187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ecf5ac54534d94bb337411928920ed)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:02.880137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:02.926757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ecf5ac54534d94bb337411928920ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:02.934746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ecf5ac54534d94bb337411928920ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:02.947694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ecf5ac54534d94bb337411928920ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:02.948426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ecf5ac54534d94bb337411928920ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:02.949046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ecf5ac54534d94bb337411928920ed'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:02.961916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1276/2557] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:02 2022] DELETE /identity/v3/users/17ecf5ac54534d94bb337411928920ed => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:02.966707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:02.967213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:02.967482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:02.988639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:02.989871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:03.052186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1282/2558] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:03.062053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:03.063599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:03.123465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316469c-f056-4b3d-adbd-576c99e45a61 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:03.127525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:03.128134 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:03.128405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:03.128697 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:03.137938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:03.139400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:03.149503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1277/2559] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:03.423615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:03.425214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:03.437548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426061b-eb5d-4cf2-b990-8bbdf66ad429 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:03.442718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:03.443465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:03.443812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:03.444086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] PATH_INFO: `/v3/projects/8b0c12514db84302983acc080bbba691` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:03.445241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0c12514db84302983acc080bbba691)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:03.447550 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:03.495198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0c12514db84302983acc080bbba691', 'request_id': 'req-8408c02c-2b58-48fd-a865-ff767fabd838'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.501103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0c12514db84302983acc080bbba691', 'request_id': 'req-8408c02c-2b58-48fd-a865-ff767fabd838'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.508942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0c12514db84302983acc080bbba691', 'request_id': 'req-8408c02c-2b58-48fd-a865-ff767fabd838'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.520189 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] The token cache is being invalidate because project 8b0c12514db84302983acc080bbba691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:03.520468 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.521080 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.522565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1283/2560] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:03 2022] DELETE /identity/v3/projects/8b0c12514db84302983acc080bbba691 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:03.526752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:03.536887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc38cb-bb27-4d18-9009-ca31c0fac4a9 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:03.688606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:03.729865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:03.730505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:03.730781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:03.731083 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] PATH_INFO: `/v3/users/d816d3c7dbce4fa9af876c5450a85748` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:03.732278 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d816d3c7dbce4fa9af876c5450a85748)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:03.734266 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:03.785215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd816d3c7dbce4fa9af876c5450a85748'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.795314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd816d3c7dbce4fa9af876c5450a85748'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.808765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd816d3c7dbce4fa9af876c5450a85748'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.809466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd816d3c7dbce4fa9af876c5450a85748'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.810152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-f7cb02a9-8989-410b-a39d-da526fcc76a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd816d3c7dbce4fa9af876c5450a85748'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:03.823274 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1278/2561] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:03 2022] DELETE /identity/v3/users/d816d3c7dbce4fa9af876c5450a85748 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:04.138913 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.140410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:04.153729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c02c-2b58-48fd-a865-ff767fabd838 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.201209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:04.216696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.217809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.218510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.218785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] PATH_INFO: `/v3/projects/fb9987935d0b4d7d93d106e614e3e6be` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.220136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9987935d0b4d7d93d106e614e3e6be)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.222744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.269152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9987935d0b4d7d93d106e614e3e6be', 'request_id': 'req-60034b20-f946-403b-8f7c-98dbff09c32e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:04.274476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9987935d0b4d7d93d106e614e3e6be', 'request_id': 'req-60034b20-f946-403b-8f7c-98dbff09c32e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:04.282761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9987935d0b4d7d93d106e614e3e6be', 'request_id': 'req-60034b20-f946-403b-8f7c-98dbff09c32e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:04.294389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] The token cache is being invalidate because project fb9987935d0b4d7d93d106e614e3e6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:04.294676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:04.295415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-60034b20-f946-403b-8f7c-98dbff09c32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:04.296937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1284/2562] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:04 2022] DELETE /identity/v3/projects/fb9987935d0b4d7d93d106e614e3e6be => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:04.302417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c601-3415-497e-bbbf-441fd468c291 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.302739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c601-3415-497e-bbbf-441fd468c291 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.303037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c601-3415-497e-bbbf-441fd468c291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.323333 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a504c601-3415-497e-bbbf-441fd468c291 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:04.324574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a504c601-3415-497e-bbbf-441fd468c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:04.385332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1279/2563] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:04.393349 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca7ba-ec3e-403d-b58c-c6b1e75b2b09 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.393632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca7ba-ec3e-403d-b58c-c6b1e75b2b09 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.393904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca7ba-ec3e-403d-b58c-c6b1e75b2b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.413843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d16ca7ba-ec3e-403d-b58c-c6b1e75b2b09 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:04.415072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d16ca7ba-ec3e-403d-b58c-c6b1e75b2b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:04.423732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1285/2564] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:04.428095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c601-3415-497e-bbbf-441fd468c291 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.438288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c601-3415-497e-bbbf-441fd468c291 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.443206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.443794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.444062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.444328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.444974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:04.445260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.447594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.459275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1280/2565] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:36:04.463753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ca7ba-ec3e-403d-b58c-c6b1e75b2b09 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.473383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ca7ba-ec3e-403d-b58c-c6b1e75b2b09 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.479259 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.479858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.480140 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.480401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.481035 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.482984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.513031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1286/2566] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:04 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:04.519059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.529101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce08e8b-2adf-4bc9-8344-dbba510a1862 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.562788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:04.590293 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.590934 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.591207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.591482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.592120 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.594039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.617243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1281/2567] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:04 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:04.624522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.637392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720205-7b24-419d-b6e5-1a4750592179 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.644169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.644893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.645199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.645469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.646128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.647787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.661440 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1287/2568] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:04.662670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.672893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bad51-b107-4d4e-bebe-c638fa841494 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.677642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce5f68-b77a-4c5c-99d5-476e804e63fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.678254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce5f68-b77a-4c5c-99d5-476e804e63fc admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.678549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce5f68-b77a-4c5c-99d5-476e804e63fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.678800 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce5f68-b77a-4c5c-99d5-476e804e63fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.679528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce5f68-b77a-4c5c-99d5-476e804e63fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.681119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce5f68-b77a-4c5c-99d5-476e804e63fc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.691758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1282/2569] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:04.696261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.707185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee599bc8-a168-4afa-b3be-4d5c2e51775d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.712656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.713357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.713663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.713937 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] PATH_INFO: `/v3/projects/14dee6db98b3417cbc25571ece2aeee9/users/4f8b702b84854bcdb6e5f2ad9de7d412/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.729795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14dee6db98b3417cbc25571ece2aeee9, user_id=4f8b702b84854bcdb6e5f2ad9de7d412, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.732457 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.747616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1288/2570] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:04 2022] PUT /identity/v3/projects/14dee6db98b3417cbc25571ece2aeee9/users/4f8b702b84854bcdb6e5f2ad9de7d412/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:04.759490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0899d-6520-4764-abf9-2eef378f0849 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.759808 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0899d-6520-4764-abf9-2eef378f0849 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.760079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0899d-6520-4764-abf9-2eef378f0849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.787968 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-fae0899d-6520-4764-abf9-2eef378f0849 None None] MFA Rules not processed for user `4f8b702b84854bcdb6e5f2ad9de7d412`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:04.789186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fae0899d-6520-4764-abf9-2eef378f0849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:04.858224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1283/2571] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:04.862877 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.923835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0f3c5-d4cf-4695-a4c3-e83485d5307f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:04.928845 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:04.929461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:04.929749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:04.930021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:04.930651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:04.932614 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:04.949252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:04.966132 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1289/2572] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:04 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:04.970642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0899d-6520-4764-abf9-2eef378f0849 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:04.981960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0899d-6520-4764-abf9-2eef378f0849 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:05.039919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:05.040301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.040597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.040848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.041475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:05.043434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:05.068516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1284/2573] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:04 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:05.070019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:05.080893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff923b7-1115-4412-98b1-e7cf244bf614 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:05.086020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:05.086629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.086951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.087219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.087909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:05.089511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:05.113477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1290/2574] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:05.113716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:05.123319 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12722c9a-31e6-4b38-aa28-19c67613ff6c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:05.128159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:05.128825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.129099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.129371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] PATH_INFO: `/v3/projects/0f028f0670e9417a90d4233ae396dce5/users/71a937a1e1bb4ec9b1d8ce687e9eda12/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.144651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f028f0670e9417a90d4233ae396dce5, user_id=71a937a1e1bb4ec9b1d8ce687e9eda12, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:05.147416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:05.162869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1285/2575] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:05 2022] PUT /identity/v3/projects/0f028f0670e9417a90d4233ae396dce5/users/71a937a1e1bb4ec9b1d8ce687e9eda12/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:05.167133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:05.177729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcd56b-8409-4151-b716-1520d63ee15e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:05.250254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdd3de-d7fc-4334-afe4-cef20645689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:05.251048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdd3de-d7fc-4334-afe4-cef20645689a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.251676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdd3de-d7fc-4334-afe4-cef20645689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.251676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdd3de-d7fc-4334-afe4-cef20645689a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.252458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdd3de-d7fc-4334-afe4-cef20645689a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:05.254237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdd3de-d7fc-4334-afe4-cef20645689a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:05.266432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1291/2576] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:05.271127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:05.281421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eada9-6026-470f-809c-689d7d8633cf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:05.285999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:05.286651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.286956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.287223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] PATH_INFO: `/v3/projects/0f028f0670e9417a90d4233ae396dce5/users/71a937a1e1bb4ec9b1d8ce687e9eda12/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.289101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f028f0670e9417a90d4233ae396dce5, user_id=71a937a1e1bb4ec9b1d8ce687e9eda12, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:05.292148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:05.295689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:05.310746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1286/2577] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:05 2022] PUT /identity/v3/projects/0f028f0670e9417a90d4233ae396dce5/users/71a937a1e1bb4ec9b1d8ce687e9eda12/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:05.315271 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.315555 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.315824 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.349867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] MFA Rules not processed for user `71a937a1e1bb4ec9b1d8ce687e9eda12`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:05.351304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:05.430385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1292/2578] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:05.441793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:05.443799 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:05.507816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386e7e-5c3a-44a1-b067-49ffba6e8aac admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:05.511757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:05.512379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.512625 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.512921 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.523383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:05.524853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:05.535626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1287/2579] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:05.788909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:05.790368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:05.876212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:05.882698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa6ac-3cb8-4d50-b239-1052f4971aa4 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:05.893099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03821e9b-602a-4c6f-819e-387808122373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:05.893860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03821e9b-602a-4c6f-819e-387808122373 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:05.894276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03821e9b-602a-4c6f-819e-387808122373 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:05.894549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03821e9b-602a-4c6f-819e-387808122373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:05.897607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-03821e9b-602a-4c6f-819e-387808122373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:05.918967 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03821e9b-602a-4c6f-819e-387808122373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:05.920615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03821e9b-602a-4c6f-819e-387808122373 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:05.933838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1293/2580] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:06.217179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:06.280515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748979e-edb5-4c62-bae2-6ca76e2bc0af service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:06.284999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:06.285632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:06.285904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:06.286175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] PATH_INFO: `/v3/users/4f8b702b84854bcdb6e5f2ad9de7d412` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:06.287317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8b702b84854bcdb6e5f2ad9de7d412)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:06.289246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:06.346682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8b702b84854bcdb6e5f2ad9de7d412'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:06.357494 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8b702b84854bcdb6e5f2ad9de7d412'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:06.375483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8b702b84854bcdb6e5f2ad9de7d412'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:06.376476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8b702b84854bcdb6e5f2ad9de7d412'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:06.377554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8b702b84854bcdb6e5f2ad9de7d412'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:06.399490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1288/2581] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:06 2022] DELETE /identity/v3/users/4f8b702b84854bcdb6e5f2ad9de7d412 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:06.401968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:06.403361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:06.403817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:06.426956 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:06.429058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:06.522363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1294/2582] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:06.532415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:06.533998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:06.554983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:06.595271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ef81-8e40-4314-8b3e-c4a21b771406 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:06.599241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:06.599953 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:06.600207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:06.600471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:06.610157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:06.611690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:06.621915 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1289/2583] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:06.899561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:06.901534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:06.913500 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaebf24-a4c2-423f-9ca5-73f926c0e317 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:06.919344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:06.919960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:06.920237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:06.920505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] PATH_INFO: `/v3/projects/14dee6db98b3417cbc25571ece2aeee9` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:06.921732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14dee6db98b3417cbc25571ece2aeee9)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:06.923710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:06.976441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14dee6db98b3417cbc25571ece2aeee9', 'request_id': 'req-be41ab51-34f8-4c84-9afe-237d196ae859'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:06.982354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14dee6db98b3417cbc25571ece2aeee9', 'request_id': 'req-be41ab51-34f8-4c84-9afe-237d196ae859'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:06.991791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14dee6db98b3417cbc25571ece2aeee9', 'request_id': 'req-be41ab51-34f8-4c84-9afe-237d196ae859'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.002987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] The token cache is being invalidate because project 14dee6db98b3417cbc25571ece2aeee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:07.003243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.003870 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.005410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1295/2584] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:06 2022] DELETE /identity/v3/projects/14dee6db98b3417cbc25571ece2aeee9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:07.009796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:07.019736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c48e0-a8e7-451f-89fa-cba585e04541 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:07.075794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:07.076439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.076735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.077004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] PATH_INFO: `/v3/users/71a937a1e1bb4ec9b1d8ce687e9eda12` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.078231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a937a1e1bb4ec9b1d8ce687e9eda12)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:07.080145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:07.129757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a937a1e1bb4ec9b1d8ce687e9eda12'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.138328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a937a1e1bb4ec9b1d8ce687e9eda12'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.152529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a937a1e1bb4ec9b1d8ce687e9eda12'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.153252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a937a1e1bb4ec9b1d8ce687e9eda12'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.153945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ff7691b3-9a4a-4986-850a-40c9aa3fd692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a937a1e1bb4ec9b1d8ce687e9eda12'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.167253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1290/2585] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:07 2022] DELETE /identity/v3/users/71a937a1e1bb4ec9b1d8ce687e9eda12 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:07.445705 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:07.447677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:07.472306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ab51-34f8-4c84-9afe-237d196ae859 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:07.534409 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:07.535209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.535471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.535744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] PATH_INFO: `/v3/projects/0f028f0670e9417a90d4233ae396dce5` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.536881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f028f0670e9417a90d4233ae396dce5)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:07.539606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:07.560919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:07.602756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f028f0670e9417a90d4233ae396dce5', 'request_id': 'req-335850e7-45a0-4b85-af39-d4b8428380f6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.608561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f028f0670e9417a90d4233ae396dce5', 'request_id': 'req-335850e7-45a0-4b85-af39-d4b8428380f6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.618532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f028f0670e9417a90d4233ae396dce5', 'request_id': 'req-335850e7-45a0-4b85-af39-d4b8428380f6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.638001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] The token cache is being invalidate because project 0f028f0670e9417a90d4233ae396dce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:07.638289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.638995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-335850e7-45a0-4b85-af39-d4b8428380f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:07.642921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1296/2586] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:07 2022] DELETE /identity/v3/projects/0f028f0670e9417a90d4233ae396dce5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:07.645642 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc896ed-89fa-42fe-be0d-d959db5bd0c7 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.646104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc896ed-89fa-42fe-be0d-d959db5bd0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.646206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc896ed-89fa-42fe-be0d-d959db5bd0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.666815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-0cc896ed-89fa-42fe-be0d-d959db5bd0c7 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:07.668057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-0cc896ed-89fa-42fe-be0d-d959db5bd0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:07.701759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:07.737886 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1291/2587] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:07.745799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903242c4-6a05-4c6c-984f-5dd5f1bb4547 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.746079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903242c4-6a05-4c6c-984f-5dd5f1bb4547 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.746350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903242c4-6a05-4c6c-984f-5dd5f1bb4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.766359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-903242c4-6a05-4c6c-984f-5dd5f1bb4547 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:07.767623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-903242c4-6a05-4c6c-984f-5dd5f1bb4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:07.776147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1297/2588] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:07.780201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc896ed-89fa-42fe-be0d-d959db5bd0c7 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:07.792534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc896ed-89fa-42fe-be0d-d959db5bd0c7 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:07.795366 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:07.795970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.796247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.796511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.797156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:07.797451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:07.799516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:07.811933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1292/2589] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:36:07.816149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903242c4-6a05-4c6c-984f-5dd5f1bb4547 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:07.826107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903242c4-6a05-4c6c-984f-5dd5f1bb4547 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:07.830574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:07.831263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.831537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.831800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.832438 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:07.834337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:07.863784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1298/2590] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:07 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:07.868580 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:07.879450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25606305-9e97-4a78-9be9-e073dd7a4da9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:07.937699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:07.938477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.938751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.939051 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.939695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:07.941728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:07.964578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1293/2591] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:07 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:07.969004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:07.980197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd213b-c19f-4732-9ddb-b588937cb68e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:07.985065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:07.985713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:07.986015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:07.986285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:07.987014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:07.988672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:07.999372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1299/2592] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:08.003783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:08.014426 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b8562-cb18-4496-a123-2669123fd261 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:08.020135 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9fc6-e2c7-4d9c-802d-6de1dc5ff58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:08.020759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9fc6-e2c7-4d9c-802d-6de1dc5ff58a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:08.021040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9fc6-e2c7-4d9c-802d-6de1dc5ff58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:08.021313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9fc6-e2c7-4d9c-802d-6de1dc5ff58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:08.021963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9fc6-e2c7-4d9c-802d-6de1dc5ff58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:08.023879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9fc6-e2c7-4d9c-802d-6de1dc5ff58a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:08.036584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1294/2593] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:08.041531 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:08.053602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e1056-c8ae-4f8a-bedc-4cea7caca2d1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:08.058474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:08.059263 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:08.059617 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:08.059961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] PATH_INFO: `/v3/projects/764c552cde9f4e28b2eea3c50d8281f8/users/48111b41dc4e491499236a56d5839d33/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:08.076207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] RBAC: Authorizing `identity:create_grant(project_id=764c552cde9f4e28b2eea3c50d8281f8, user_id=48111b41dc4e491499236a56d5839d33, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:08.079070 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:08.094149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1300/2594] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:08 2022] PUT /identity/v3/projects/764c552cde9f4e28b2eea3c50d8281f8/users/48111b41dc4e491499236a56d5839d33/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:08.109984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:08.110270 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:08.110543 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:08.151621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] MFA Rules not processed for user `48111b41dc4e491499236a56d5839d33`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:08.153219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:08.233465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1295/2595] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:08.284879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:08.286628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:08.352292 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198de36-9b37-47af-90c0-e4959c7c374d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:08.356124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:08.356822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:08.357137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:08.357423 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:08.367487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:08.368964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:08.379287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1301/2596] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:11.091867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:11.093685 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:11.136068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:11.154607 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c35dd4-c5a3-4c0a-b95b-e5e331c4a1ba None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:11.158179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ed507-920f-4591-a023-22a1e9af7392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:11.158876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ed507-920f-4591-a023-22a1e9af7392 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:11.159183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ed507-920f-4591-a023-22a1e9af7392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:11.159456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ed507-920f-4591-a023-22a1e9af7392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:11.161178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-3c0ed507-920f-4591-a023-22a1e9af7392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:11.229994 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ed507-920f-4591-a023-22a1e9af7392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:11.231398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ed507-920f-4591-a023-22a1e9af7392 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:11.241441 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1296/2597] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:13.884034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:13.894771 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a299a2c-46dc-43d6-9dbe-5bb29cd71c99 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:13.899753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:13.900372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:13.900639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:13.900907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] PATH_INFO: `/v3/users/48111b41dc4e491499236a56d5839d33` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:13.902050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48111b41dc4e491499236a56d5839d33)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:13.903995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:13.963657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:13.988958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48111b41dc4e491499236a56d5839d33'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.001560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48111b41dc4e491499236a56d5839d33'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.002410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48111b41dc4e491499236a56d5839d33'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.002939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48111b41dc4e491499236a56d5839d33'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.017213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48111b41dc4e491499236a56d5839d33'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.048817 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1302/2598] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:13 2022] DELETE /identity/v3/users/48111b41dc4e491499236a56d5839d33 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:14.053502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.053952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.054056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.075974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:14.079937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.157691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1297/2599] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:14.173654 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:14.175164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.257391 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ea7a-bf60-469f-aac8-399ea2d0a5f6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:14.273977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:14.275207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.275527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.275811 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.291968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:14.294451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:14.294740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:14.296524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.306569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1303/2600] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:14.380855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:14.384226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.388988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a12ae5-4b4d-44d7-9976-8ce4b8bba40e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:14.397709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:14.398966 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.399372 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.399716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.401090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56d014-42f1-45a3-9880-1913fc46006a service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:14.401698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.405828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:14.406548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.406984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.407351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] PATH_INFO: `/v3/users/0e421a45c825416fa5bf4aec29ed0c6b` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.408768 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e421a45c825416fa5bf4aec29ed0c6b)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:14.410849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:14.415445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:14.418567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:14.435001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1298/2601] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:14.471626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e421a45c825416fa5bf4aec29ed0c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.481235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e421a45c825416fa5bf4aec29ed0c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.481950 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e421a45c825416fa5bf4aec29ed0c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.482583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e421a45c825416fa5bf4aec29ed0c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.493628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e421a45c825416fa5bf4aec29ed0c6b'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.513127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1304/2602] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:14 2022] DELETE /identity/v3/users/0e421a45c825416fa5bf4aec29ed0c6b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:14.685918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:14.687838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.703058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e4d97-b09e-4a30-9e19-57d32b064179 service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:14.713317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:14.714792 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.720682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=100 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:14.754866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:14.769400 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:14.770142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.770564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.770925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] PATH_INFO: `/v3/projects/764c552cde9f4e28b2eea3c50d8281f8` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.772109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764c552cde9f4e28b2eea3c50d8281f8)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:14.774101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:14.787912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03bf5-388a-4035-aba1-513770eb2f3a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:14.793022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:14.793671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.793951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.794224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] PATH_INFO: `/v3/projects/a171567589504cd19122a993881d5250` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.795729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a171567589504cd19122a993881d5250)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:14.797698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:14.820791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764c552cde9f4e28b2eea3c50d8281f8', 'request_id': 'req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.830514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764c552cde9f4e28b2eea3c50d8281f8', 'request_id': 'req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.837058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764c552cde9f4e28b2eea3c50d8281f8', 'request_id': 'req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.847060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a171567589504cd19122a993881d5250', 'request_id': 'req-50607002-7cec-46c3-8a10-c26d60625de4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.848335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] The token cache is being invalidate because project 764c552cde9f4e28b2eea3c50d8281f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:14.848616 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.849240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-70240243-eb1c-4ca5-bfe5-9d631a2a9e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.850727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1299/2603] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:14 2022] DELETE /identity/v3/projects/764c552cde9f4e28b2eea3c50d8281f8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:14.855480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a99bc-31a2-4d5c-84d4-f57ee00a8258 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.855753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a99bc-31a2-4d5c-84d4-f57ee00a8258 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.856019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a99bc-31a2-4d5c-84d4-f57ee00a8258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.856119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a171567589504cd19122a993881d5250', 'request_id': 'req-50607002-7cec-46c3-8a10-c26d60625de4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.864537 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a171567589504cd19122a993881d5250', 'request_id': 'req-50607002-7cec-46c3-8a10-c26d60625de4'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.875358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-495a99bc-31a2-4d5c-84d4-f57ee00a8258 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:14.876068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] The token cache is being invalidate because project a171567589504cd19122a993881d5250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:14.876356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.876548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-495a99bc-31a2-4d5c-84d4-f57ee00a8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.877083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-50607002-7cec-46c3-8a10-c26d60625de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:14.878998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1305/2604] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:14 2022] DELETE /identity/v3/projects/a171567589504cd19122a993881d5250 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:14.884378 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509190-125b-452d-9f03-66e4e323a03f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.884975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509190-125b-452d-9f03-66e4e323a03f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.884975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509190-125b-452d-9f03-66e4e323a03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.903986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a4509190-125b-452d-9f03-66e4e323a03f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:14.905179 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a4509190-125b-452d-9f03-66e4e323a03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.935577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1300/2605] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:14.943268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1594023-f9ed-423d-a475-f48e41130a93 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.943554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1594023-f9ed-423d-a475-f48e41130a93 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.943814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1594023-f9ed-423d-a475-f48e41130a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.963606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b1594023-f9ed-423d-a475-f48e41130a93 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:14.964942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1306/2606] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:14.965318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b1594023-f9ed-423d-a475-f48e41130a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.973605 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a3714-6e59-4f26-98dc-e7854307be47 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.976769 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a3714-6e59-4f26-98dc-e7854307be47 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.976903 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1301/2607] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:14.977026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a3714-6e59-4f26-98dc-e7854307be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.977851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1594023-f9ed-423d-a475-f48e41130a93 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:14.987091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1594023-f9ed-423d-a475-f48e41130a93 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:14.992751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:14.993446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:14.993729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:14.993871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-484a3714-6e59-4f26-98dc-e7854307be47 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:14.993972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:14.994614 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:14.994948 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:14.995112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-484a3714-6e59-4f26-98dc-e7854307be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:14.996540 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.003731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1307/2608] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:15.007516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a3714-6e59-4f26-98dc-e7854307be47 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.008893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1302/2609] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:36:15.013827 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.016583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a3714-6e59-4f26-98dc-e7854307be47 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.021288 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.021879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.022137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.022402 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.023131 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:15.023415 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.023542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688ed4f-f522-4612-95d4-0322a8e5446b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.025014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.027978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.028549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.028820 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.029085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.029700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.031573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.036569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1308/2610] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:36:15.040880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.050388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d4a56-db2b-4cfb-ae68-b188ebf4c5c8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.055944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.056615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.056887 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.057154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.057801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.059763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.063039 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1303/2611] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:15.067218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.073515 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:15.092799 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1309/2612] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:15.096982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.119611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:15.133337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db9cc4-749f-4d62-b24a-00acadd91c37 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.161691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cda8f-9f90-4dee-9682-b4dc790c6af9 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.166504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.167141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.167417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.167680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.168317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.170267 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.191179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.191804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.192060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.192324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.192430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1310/2613] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:15.192984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.194905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.196093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.206808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664763c3-33bc-4310-81a2-44167ff04c18 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.213901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.214501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.214838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.215114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.215772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.217376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.218183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1304/2614] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:36:15.222264 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.228268 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1311/2615] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:15.231861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d63dfc-8043-47ea-b135-320f98129386 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.232142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.236467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.237125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.237396 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.237660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.238295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.239906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.241891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05bc40-db8f-42b5-8eb6-ef283d9366fb admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.246567 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.247186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.247463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.247737 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.248369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.249916 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1305/2616] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:15.250143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.253757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.264062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1312/2617] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:15.264239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b602-f98b-46d4-b4d8-d59346b087a7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.265093 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.268008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.268602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.268875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.269260 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.269932 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.271525 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.274965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e98b0-f44e-4357-81b0-741f05acf989 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.279863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e9afc-306c-485e-a173-ddc51bd4eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.280514 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9afc-306c-485e-a173-ddc51bd4eb08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.280789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9afc-306c-485e-a173-ddc51bd4eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.281063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9afc-306c-485e-a173-ddc51bd4eb08 admin admin] PATH_INFO: `/v3/projects/77200dac47464f42a7b58e89ad30c63c/users/ce7ab33123d146228c4e6101bc0b5fd6/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.282202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1306/2618] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:15.286159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.295718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f5143-31f7-4056-89db-3d5fb2eac820 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.296022 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e9afc-306c-485e-a173-ddc51bd4eb08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77200dac47464f42a7b58e89ad30c63c, user_id=ce7ab33123d146228c4e6101bc0b5fd6, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.298918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e9afc-306c-485e-a173-ddc51bd4eb08 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.300295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793d29-e764-4db1-9712-e78491095e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.300927 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793d29-e764-4db1-9712-e78491095e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.301201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793d29-e764-4db1-9712-e78491095e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.301465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793d29-e764-4db1-9712-e78491095e98 admin admin] PATH_INFO: `/v3/projects/7dafca8eb2f645ba8063843cbbe019c5/users/bf8eb89b7ddb490d8ce7a6c8dea06135/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.313744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1313/2619] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:15 2022] PUT /identity/v3/projects/77200dac47464f42a7b58e89ad30c63c/users/ce7ab33123d146228c4e6101bc0b5fd6/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:15.322975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793d29-e764-4db1-9712-e78491095e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dafca8eb2f645ba8063843cbbe019c5, user_id=bf8eb89b7ddb490d8ce7a6c8dea06135, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.322975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793d29-e764-4db1-9712-e78491095e98 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.324622 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec0d4-3f58-4195-bd06-f8fa265dc1fe None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.324985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec0d4-3f58-4195-bd06-f8fa265dc1fe None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.325368 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec0d4-3f58-4195-bd06-f8fa265dc1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.332676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1307/2620] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:15 2022] PUT /identity/v3/projects/7dafca8eb2f645ba8063843cbbe019c5/users/bf8eb89b7ddb490d8ce7a6c8dea06135/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:15.343841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7882c-620e-4d39-8bd4-1406ffdadfd9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.344192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7882c-620e-4d39-8bd4-1406ffdadfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.344558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7882c-620e-4d39-8bd4-1406ffdadfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.357081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6e3ec0d4-3f58-4195-bd06-f8fa265dc1fe None None] MFA Rules not processed for user `ce7ab33123d146228c4e6101bc0b5fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:15.359230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6e3ec0d4-3f58-4195-bd06-f8fa265dc1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:15.386521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-47e7882c-620e-4d39-8bd4-1406ffdadfd9 None None] MFA Rules not processed for user `bf8eb89b7ddb490d8ce7a6c8dea06135`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:15.388187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-47e7882c-620e-4d39-8bd4-1406ffdadfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:15.454603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1314/2621] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:15.454876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:15.459299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ec0d4-3f58-4195-bd06-f8fa265dc1fe None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.484020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1308/2622] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:15.487947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7882c-620e-4d39-8bd4-1406ffdadfd9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.517604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:15.532747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ec0d4-3f58-4195-bd06-f8fa265dc1fe None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.538209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.538856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.539161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.539444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.540083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.541997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.563411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7882c-620e-4d39-8bd4-1406ffdadfd9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.568173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.568801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.569055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.569332 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.572921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1315/2623] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:36:15.573059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.573059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.573858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.600565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1309/2624] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:15.604554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.636828 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024078bd-ecb5-4578-b809-76791f7211e1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.668052 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637497-edf7-40b2-bf17-a45a37a94aa9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.672876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.673541 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.673814 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.674090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.674744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.676728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.694414 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.695069 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.695345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.695612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.696241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.698018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1310/2625] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:36:15.698522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.701942 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.713338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed62c-b295-4150-8032-1c5e1b878a19 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.718062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.718652 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.718971 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.719227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.719864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.723257 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1316/2626] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:36:15.723421 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.724633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.734484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1311/2627] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:15.734931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abcd13-decc-487a-935b-48f17715147e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.735516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.739568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.740159 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.740435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.740701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.741338 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.742953 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.745368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40359d83-3e59-42d6-9ecf-2fdd112d0122 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.750615 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.751368 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.751644 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.751912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] PATH_INFO: `/v3/projects/b0d257ac09ef45cfa050563864fe0e95/users/d27f138e44e14f8eb07cff954f14df20/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.752765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1317/2628] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:15.756781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.766389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dbdaa-70c8-43cb-923d-68c631cf89fa admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.768310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d257ac09ef45cfa050563864fe0e95, user_id=d27f138e44e14f8eb07cff954f14df20, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.771045 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.771313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.771974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.772254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.772526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] PATH_INFO: `/v3/projects/04a28f77928d4a9db339aba73e03cdde/users/e71925cfc33d4b55988facce20e6e9a1/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.785159 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1312/2629] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:15 2022] PUT /identity/v3/projects/b0d257ac09ef45cfa050563864fe0e95/users/d27f138e44e14f8eb07cff954f14df20/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:15.789123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a28f77928d4a9db339aba73e03cdde, user_id=e71925cfc33d4b55988facce20e6e9a1, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.789353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.791834 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.807744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1318/2630] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:15 2022] PUT /identity/v3/projects/04a28f77928d4a9db339aba73e03cdde/users/e71925cfc33d4b55988facce20e6e9a1/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:15.811634 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.817015 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:15.853949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a97a9d-fae3-497d-9df6-e5f2a01cd838 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.854987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:15.876216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f7d9-2baa-496b-add6-10cb5255f212 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.881463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.882104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.882381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.882651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.883411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.885025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.895239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1319/2631] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:15.899412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.909079 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c720231-fefe-4e9e-b948-c9e2556d03a0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.911204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.911821 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.912099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.912371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.913010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.913996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999ce74-d862-4d24-b705-6f260d8c8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.914603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.914720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999ce74-d862-4d24-b705-6f260d8c8a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.914936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999ce74-d862-4d24-b705-6f260d8c8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.915203 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999ce74-d862-4d24-b705-6f260d8c8a5c admin admin] PATH_INFO: `/v3/projects/04a28f77928d4a9db339aba73e03cdde/users/e71925cfc33d4b55988facce20e6e9a1/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.917128 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999ce74-d862-4d24-b705-6f260d8c8a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a28f77928d4a9db339aba73e03cdde, user_id=e71925cfc33d4b55988facce20e6e9a1, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:15.919764 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999ce74-d862-4d24-b705-6f260d8c8a5c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:15.924775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1313/2632] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:15.928775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:15.930982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1320/2633] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:15 2022] PUT /identity/v3/projects/04a28f77928d4a9db339aba73e03cdde/users/e71925cfc33d4b55988facce20e6e9a1/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:15.938626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eba669-8383-43c6-a83c-7dc8a1fcbe7a admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:15.942352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.942633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.942931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:15.971802 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] MFA Rules not processed for user `e71925cfc33d4b55988facce20e6e9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:15.973055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:15.997724 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906e9c3-e090-451e-9d4f-f14cb6fbf45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:15.998369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906e9c3-e090-451e-9d4f-f14cb6fbf45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:15.998637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906e9c3-e090-451e-9d4f-f14cb6fbf45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:15.998933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906e9c3-e090-451e-9d4f-f14cb6fbf45b admin admin] PATH_INFO: `/v3/projects/b0d257ac09ef45cfa050563864fe0e95/users/d27f138e44e14f8eb07cff954f14df20/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:16.001009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906e9c3-e090-451e-9d4f-f14cb6fbf45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d257ac09ef45cfa050563864fe0e95, user_id=d27f138e44e14f8eb07cff954f14df20, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:16.003758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906e9c3-e090-451e-9d4f-f14cb6fbf45b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:16.013964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1314/2634] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:15 2022] PUT /identity/v3/projects/b0d257ac09ef45cfa050563864fe0e95/users/d27f138e44e14f8eb07cff954f14df20/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:16.024645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:16.024931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:16.025206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:16.041739 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1321/2635] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:16.053309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:16.054410 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] MFA Rules not processed for user `d27f138e44e14f8eb07cff954f14df20`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:16.054785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:16.055650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:16.104283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:16.114283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3f74e-7f86-4248-9de0-0c0eb4181f7e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:16.130365 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1315/2636] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:16.137877 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:16.139348 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:16.161994 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:16.162535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:16.162805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:16.163095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:16.179296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:16.198654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024b5d-b092-4039-aba9-70a912404fbd None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:16.202303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed08d99-d6e3-4775-81ff-5039d6e06558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:16.202952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed08d99-d6e3-4775-81ff-5039d6e06558 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:16.203233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed08d99-d6e3-4775-81ff-5039d6e06558 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:16.203497 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed08d99-d6e3-4775-81ff-5039d6e06558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:16.223357 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:16.224915 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:16.234933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1322/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:16.259897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed08d99-d6e3-4775-81ff-5039d6e06558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:16.261509 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed08d99-d6e3-4775-81ff-5039d6e06558 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:16.270748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1316/2638] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:16.304569 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:16.369032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5a579-5cb4-4a0a-a27f-afb8be0dcdf0 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:16.373797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:16.374513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:16.374876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:16.375224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] PATH_INFO: `/v3/users/ce7ab33123d146228c4e6101bc0b5fd6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:16.376451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7ab33123d146228c4e6101bc0b5fd6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:16.378650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:16.427532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7ab33123d146228c4e6101bc0b5fd6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:16.435736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7ab33123d146228c4e6101bc0b5fd6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:16.436539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7ab33123d146228c4e6101bc0b5fd6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:16.437192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7ab33123d146228c4e6101bc0b5fd6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:16.444702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7ab33123d146228c4e6101bc0b5fd6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:16.463900 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1323/2639] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:16 2022] DELETE /identity/v3/users/ce7ab33123d146228c4e6101bc0b5fd6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:16.468413 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:16.468706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:16.469021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:16.490019 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:16.491404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:16.564604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1317/2640] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:16.580114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:16.581970 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:16.630593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:16.654991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e11a2c-cbdd-44cb-98ef-26eb5364e538 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:16.658762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:16.659442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:16.659700 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:16.659968 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:16.669362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:16.670864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:16.681305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1324/2641] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:16.977523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:16.979097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:16.992444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bc838-b17a-4077-91f6-e07a2b4b4f7d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:16.997505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:16.998212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:16.998451 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:16.998744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] PATH_INFO: `/v3/projects/77200dac47464f42a7b58e89ad30c63c` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:17.000008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77200dac47464f42a7b58e89ad30c63c)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:17.002072 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:17.052456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:17.065522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77200dac47464f42a7b58e89ad30c63c', 'request_id': 'req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.074503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77200dac47464f42a7b58e89ad30c63c', 'request_id': 'req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.080230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77200dac47464f42a7b58e89ad30c63c', 'request_id': 'req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.091288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] The token cache is being invalidate because project 77200dac47464f42a7b58e89ad30c63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:17.091574 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.092216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.093794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1318/2642] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:16 2022] DELETE /identity/v3/projects/77200dac47464f42a7b58e89ad30c63c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:17.097976 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:17.107714 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1cdfc-25c9-4567-a022-dcfaa02e0ce1 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:17.168721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:17.169341 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:17.169623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:17.169893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] PATH_INFO: `/v3/users/e71925cfc33d4b55988facce20e6e9a1` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:17.171123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71925cfc33d4b55988facce20e6e9a1)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:17.173062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:17.222114 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71925cfc33d4b55988facce20e6e9a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.230475 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71925cfc33d4b55988facce20e6e9a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.231180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71925cfc33d4b55988facce20e6e9a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.231862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71925cfc33d4b55988facce20e6e9a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.238975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-2361ea86-4063-47b0-958a-db007a8a8b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71925cfc33d4b55988facce20e6e9a1'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.256221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1325/2643] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:17 2022] DELETE /identity/v3/users/e71925cfc33d4b55988facce20e6e9a1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:17.547819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:17.549484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:17.566510 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc91ad-e69b-4b5c-84da-e1fe6f3a4f95 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:17.635442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:17.636104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:17.636379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:17.636649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] PATH_INFO: `/v3/projects/04a28f77928d4a9db339aba73e03cdde` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:17.637880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a28f77928d4a9db339aba73e03cdde)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:17.639857 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:17.689695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a28f77928d4a9db339aba73e03cdde', 'request_id': 'req-fe958517-6ec7-458d-9eb7-64607c1b21e2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.698299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a28f77928d4a9db339aba73e03cdde', 'request_id': 'req-fe958517-6ec7-458d-9eb7-64607c1b21e2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.704390 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a28f77928d4a9db339aba73e03cdde', 'request_id': 'req-fe958517-6ec7-458d-9eb7-64607c1b21e2'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.715875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] The token cache is being invalidate because project 04a28f77928d4a9db339aba73e03cdde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:17.716169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.716989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-fe958517-6ec7-458d-9eb7-64607c1b21e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:17.718587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1319/2644] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:17 2022] DELETE /identity/v3/projects/04a28f77928d4a9db339aba73e03cdde => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:17.724872 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f1be3-56bd-4fa0-9dbb-caf5e9eb2c7a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:17.725161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f1be3-56bd-4fa0-9dbb-caf5e9eb2c7a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:17.725460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f1be3-56bd-4fa0-9dbb-caf5e9eb2c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:17.746492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-046f1be3-56bd-4fa0-9dbb-caf5e9eb2c7a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:17.747864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-046f1be3-56bd-4fa0-9dbb-caf5e9eb2c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:17.811702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:17.826892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1326/2645] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:17.834753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ac79-6754-46ea-a7fe-d0e4013b32c6 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:17.835028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ac79-6754-46ea-a7fe-d0e4013b32c6 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:17.835317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301ac79-6754-46ea-a7fe-d0e4013b32c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:17.855481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9301ac79-6754-46ea-a7fe-d0e4013b32c6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:17.856709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9301ac79-6754-46ea-a7fe-d0e4013b32c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:17.865292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1320/2646] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:17.869736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f1be3-56bd-4fa0-9dbb-caf5e9eb2c7a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:17.880214 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f1be3-56bd-4fa0-9dbb-caf5e9eb2c7a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:17.885239 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:17.885848 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:17.886119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:17.886388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:17.887062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:17.887362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:17.888987 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:17.902857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1327/2647] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:36:17.906311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301ac79-6754-46ea-a7fe-d0e4013b32c6 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:17.924163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301ac79-6754-46ea-a7fe-d0e4013b32c6 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:17.928951 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:17.929564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:17.929843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:17.930113 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:17.930791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:17.933564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:17.963572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1321/2648] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:17 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:36:17.967888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:17.979057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c65b9d-6c21-48ad-944f-b8fbae7ad864 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:18.042344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:18.042863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:18.043164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:18.043434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:18.044056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:18.046020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:18.071853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1328/2649] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:17 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:18.076066 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:18.087116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ecfb-04e7-4034-b8b5-fc982c1fb723 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:18.091930 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:18.092537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:18.092811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:18.093080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:18.093720 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:18.095355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:18.105449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1322/2650] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:18.109660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:18.119931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3fdd2-427b-4320-ab05-d2e196c3c47d admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:18.125182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a72f5e-130d-436d-a113-abf1e438f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:18.125789 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a72f5e-130d-436d-a113-abf1e438f074 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:18.126152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a72f5e-130d-436d-a113-abf1e438f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:18.126265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a72f5e-130d-436d-a113-abf1e438f074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:18.126979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a72f5e-130d-436d-a113-abf1e438f074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:18.128576 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a72f5e-130d-436d-a113-abf1e438f074 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:18.139206 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1329/2651] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:18.143420 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:18.153273 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010d18d-b9ab-4a2c-9d5d-fd457c584540 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:18.158448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:18.159164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:18.159444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:18.159709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] PATH_INFO: `/v3/projects/c1084d66b9264949889f8bf8bc1c02c7/users/87051ca89fdb4f45a5793c20c0f865ce/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:18.171923 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:18.175191 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1084d66b9264949889f8bf8bc1c02c7, user_id=87051ca89fdb4f45a5793c20c0f865ce, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:18.178211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:18.192816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1323/2652] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:18 2022] PUT /identity/v3/projects/c1084d66b9264949889f8bf8bc1c02c7/users/87051ca89fdb4f45a5793c20c0f865ce/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:18.203935 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:18.204202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:18.204488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:18.233585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] MFA Rules not processed for user `87051ca89fdb4f45a5793c20c0f865ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:18.234813 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:18.307461 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1330/2653] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:18.318528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:18.320564 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:18.387976 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687fe60-75d5-475d-b899-bd8e034fb615 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:18.392080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed8991-c5bb-4d88-9d54-a3913a80eb4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:18.392676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8991-c5bb-4d88-9d54-a3913a80eb4e service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:18.392945 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8991-c5bb-4d88-9d54-a3913a80eb4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:18.393213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8991-c5bb-4d88-9d54-a3913a80eb4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:18.401708 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed8991-c5bb-4d88-9d54-a3913a80eb4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:18.403153 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed8991-c5bb-4d88-9d54-a3913a80eb4e service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:18.411806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1324/2654] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:18.839960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:18.841636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:18.897218 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:18.912899 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6c07-e0dc-490a-bd0e-2e12b7b911c3 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:18.917432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:18.918056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:18.918329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:18.918597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] PATH_INFO: `/v3/users/bf8eb89b7ddb490d8ce7a6c8dea06135` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:18.919757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8eb89b7ddb490d8ce7a6c8dea06135)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:18.921711 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:18.988471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8eb89b7ddb490d8ce7a6c8dea06135'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:18.998847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8eb89b7ddb490d8ce7a6c8dea06135'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:18.999474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8eb89b7ddb490d8ce7a6c8dea06135'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.000231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8eb89b7ddb490d8ce7a6c8dea06135'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.008464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8eb89b7ddb490d8ce7a6c8dea06135'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.027377 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1331/2655] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:18 2022] DELETE /identity/v3/users/bf8eb89b7ddb490d8ce7a6c8dea06135 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:19.032059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:19.032517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:19.032634 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:19.052353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:19.053592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:19.112986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1325/2656] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:19.122702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:19.124126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:19.183142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043af2ea-38e7-4a1d-9178-ce7fee9c4503 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:19.187350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:19.187958 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:19.188236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:19.188508 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:19.198673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:19.200142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:19.209544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1332/2657] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:19.493587 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:19.495192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:19.507381 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f4efd-8659-4a37-90d2-cf8b30b6d324 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:19.512712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:19.513349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:19.513621 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:19.513918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] PATH_INFO: `/v3/projects/7dafca8eb2f645ba8063843cbbe019c5` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:19.515097 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dafca8eb2f645ba8063843cbbe019c5)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:19.516995 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:19.565358 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dafca8eb2f645ba8063843cbbe019c5', 'request_id': 'req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.573035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dafca8eb2f645ba8063843cbbe019c5', 'request_id': 'req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.578944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dafca8eb2f645ba8063843cbbe019c5', 'request_id': 'req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.590431 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] The token cache is being invalidate because project 7dafca8eb2f645ba8063843cbbe019c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:19.590719 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.591476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.593056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1326/2658] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:19 2022] DELETE /identity/v3/projects/7dafca8eb2f645ba8063843cbbe019c5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:19.597188 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:19.606991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7289-0653-4b1e-9b65-7f4d3edd2bbf service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:19.668153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:19.668794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:19.669067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:19.669331 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] PATH_INFO: `/v3/users/d27f138e44e14f8eb07cff954f14df20` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:19.670446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27f138e44e14f8eb07cff954f14df20)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:19.672420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:19.687185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:19.726442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27f138e44e14f8eb07cff954f14df20'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.736278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27f138e44e14f8eb07cff954f14df20'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.736996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27f138e44e14f8eb07cff954f14df20'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.737778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27f138e44e14f8eb07cff954f14df20'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.745004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27f138e44e14f8eb07cff954f14df20'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:19.763176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1333/2659] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:19 2022] DELETE /identity/v3/users/d27f138e44e14f8eb07cff954f14df20 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:20.047320 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:20.048789 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:20.062767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fbd54-cb22-43b2-aa6a-3d0ab27f64e8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:20.076869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:20.129054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:20.129690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:20.129961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:20.130283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] PATH_INFO: `/v3/projects/b0d257ac09ef45cfa050563864fe0e95` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:20.131450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d257ac09ef45cfa050563864fe0e95)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:20.133711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:20.194630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d257ac09ef45cfa050563864fe0e95', 'request_id': 'req-88558312-91d8-4dcb-9222-10f9d4665549'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:20.204055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d257ac09ef45cfa050563864fe0e95', 'request_id': 'req-88558312-91d8-4dcb-9222-10f9d4665549'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:20.214846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d257ac09ef45cfa050563864fe0e95', 'request_id': 'req-88558312-91d8-4dcb-9222-10f9d4665549'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:20.232185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] The token cache is being invalidate because project b0d257ac09ef45cfa050563864fe0e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:20.232479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:20.233275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-88558312-91d8-4dcb-9222-10f9d4665549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:20.234854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1327/2660] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:20 2022] DELETE /identity/v3/projects/b0d257ac09ef45cfa050563864fe0e95 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:21.483922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:21.485433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:21.500286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482c84a-fc44-4d0c-bdff-bcc4ef058b77 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:21.557434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:21.557983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:21.558252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:21.558513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] PATH_INFO: `/v3/users/87051ca89fdb4f45a5793c20c0f865ce` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:21.559757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87051ca89fdb4f45a5793c20c0f865ce)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:21.561701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:21.611674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87051ca89fdb4f45a5793c20c0f865ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:21.620356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87051ca89fdb4f45a5793c20c0f865ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:21.621018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87051ca89fdb4f45a5793c20c0f865ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:21.621630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87051ca89fdb4f45a5793c20c0f865ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:21.629065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87051ca89fdb4f45a5793c20c0f865ce'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:21.647115 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1334/2661] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:21 2022] DELETE /identity/v3/users/87051ca89fdb4f45a5793c20c0f865ce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:21.651706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:21.652216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:21.652216 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:21.672423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:21.673599 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:21.733146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1328/2662] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:21.743182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:21.744810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:21.759466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:21.805395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26231-5668-4115-97c4-d021ed7557a6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:21.809332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7a1d4-099d-4ba3-94f9-adaedb613184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:21.809876 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a1d4-099d-4ba3-94f9-adaedb613184 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:21.810150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a1d4-099d-4ba3-94f9-adaedb613184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:21.810419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a1d4-099d-4ba3-94f9-adaedb613184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:21.819294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7a1d4-099d-4ba3-94f9-adaedb613184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:21.820735 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7a1d4-099d-4ba3-94f9-adaedb613184 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:21.830276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1335/2663] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:22.108505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.110265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:22.124711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25134a-47f8-4bb3-9a5a-a7320e2f4df8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.130479 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.131280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.131781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.132053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] PATH_INFO: `/v3/projects/c1084d66b9264949889f8bf8bc1c02c7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.133310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1084d66b9264949889f8bf8bc1c02c7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.135215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.181197 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:22.185267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1084d66b9264949889f8bf8bc1c02c7', 'request_id': 'req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:22.193240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1084d66b9264949889f8bf8bc1c02c7', 'request_id': 'req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:22.199147 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1084d66b9264949889f8bf8bc1c02c7', 'request_id': 'req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:22.210198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] The token cache is being invalidate because project c1084d66b9264949889f8bf8bc1c02c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:22.210481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:22.211121 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6b9d16b2-ef3c-42cf-94c6-fcdd0ac0a255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:22.212593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1329/2664] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:22 2022] DELETE /identity/v3/projects/c1084d66b9264949889f8bf8bc1c02c7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:22.217478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195cf88-5c5c-403c-8e4a-be9acd390b0f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.217760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195cf88-5c5c-403c-8e4a-be9acd390b0f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.218029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195cf88-5c5c-403c-8e4a-be9acd390b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.237755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f195cf88-5c5c-403c-8e4a-be9acd390b0f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:22.238984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f195cf88-5c5c-403c-8e4a-be9acd390b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:22.300751 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1336/2665] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:22.309998 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67710-1a98-42fd-948a-cfe64f25176c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.310286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67710-1a98-42fd-948a-cfe64f25176c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.310552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67710-1a98-42fd-948a-cfe64f25176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.331187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-e0c67710-1a98-42fd-948a-cfe64f25176c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:22.332363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-e0c67710-1a98-42fd-948a-cfe64f25176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:22.340959 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1330/2666] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:22.345454 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195cf88-5c5c-403c-8e4a-be9acd390b0f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.355801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195cf88-5c5c-403c-8e4a-be9acd390b0f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.361101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.361701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.361973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.362248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.362897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:22.363225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.364855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.376604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1337/2667] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:36:22.381201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67710-1a98-42fd-948a-cfe64f25176c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.390863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67710-1a98-42fd-948a-cfe64f25176c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.396746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.397364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.397602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.397888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.398514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.400448 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.430758 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1331/2668] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:22 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:22.435031 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.445644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba48ed-e786-41ac-83ed-d27ae2251a14 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.504905 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.505648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.505760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.506025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.506957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.508879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.531717 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1338/2669] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:22 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:22.536049 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.546532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5017-2f5f-4c6d-85a3-7165e668a3b8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.552196 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.552926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.553207 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.553496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.554775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.556407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.566578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1332/2670] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:22.570815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.581336 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47cbe6-2409-441a-9752-bd0ea7005740 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.586221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee12d65-3a42-4373-a0bb-c04580cd6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.586960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee12d65-3a42-4373-a0bb-c04580cd6cab admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.587305 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee12d65-3a42-4373-a0bb-c04580cd6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.587583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee12d65-3a42-4373-a0bb-c04580cd6cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.588229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee12d65-3a42-4373-a0bb-c04580cd6cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.589847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee12d65-3a42-4373-a0bb-c04580cd6cab admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.601269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1339/2671] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:22.605632 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.616214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b047-8c86-4e07-bc08-66fa72d7880c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.620900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.621581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.621847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.622116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] PATH_INFO: `/v3/projects/95e97b1f02a942448d0d64e35085875c/users/9e259cb9dfa444639c289345482cf76f/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.638805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e97b1f02a942448d0d64e35085875c, user_id=9e259cb9dfa444639c289345482cf76f, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.641486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.656297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1333/2672] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:22 2022] PUT /identity/v3/projects/95e97b1f02a942448d0d64e35085875c/users/9e259cb9dfa444639c289345482cf76f/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:22.667009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1bc18-d040-4806-b8a8-db319e658253 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.667362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1bc18-d040-4806-b8a8-db319e658253 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.667713 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1bc18-d040-4806-b8a8-db319e658253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.696838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8fe1bc18-d040-4806-b8a8-db319e658253 None None] MFA Rules not processed for user `9e259cb9dfa444639c289345482cf76f`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:22.698051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8fe1bc18-d040-4806-b8a8-db319e658253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:22.706572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:22.764961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1340/2673] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:22.776902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:22.779353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:22.838845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba06e9-1ada-4429-b25b-ae2b0a975413 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:22.842875 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:22.843492 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:22.843772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:22.844029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:22.852589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:22.854001 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:22.862862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1334/2674] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:28.609615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:28.609615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:28.609615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:28.772232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:28.773407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:28.838664 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1341/2675] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:36:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:28.893941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:28.895926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:28.975522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd9ca-507e-4ce0-827c-08ede41e8e17 service glance] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:28.981376 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:28.981982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:28.982292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:28.982557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:28.990433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:28.992068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:28.996554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:29.000770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1335/2676] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:36:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:36:29.331544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:29.333432 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:29.438916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474892f8-989e-46a2-b936-210e685f36c9 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:29.449119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:29.449745 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:29.450016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:29.450287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:29.452068 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:29.465137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:29.466849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:29.479801 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1342/2677] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:30.654650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:30.656454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:30.742328 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41689a23-57fd-4160-b1f2-3eddf1356b22 service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:30.751771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8db226-1ae0-4df8-9a4f-2a491455e94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:30.752524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db226-1ae0-4df8-9a4f-2a491455e94f service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:30.752902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db226-1ae0-4df8-9a4f-2a491455e94f service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:30.753223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db226-1ae0-4df8-9a4f-2a491455e94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:30.755341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ca8db226-1ae0-4df8-9a4f-2a491455e94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:30.767439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8db226-1ae0-4df8-9a4f-2a491455e94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:30.769010 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8db226-1ae0-4df8-9a4f-2a491455e94f service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:30.779185 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1336/2678] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:39.473310 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=82 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:40.774502 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=26 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:42.450044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:42.489517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba996a30-7ed5-4f8f-a622-4517647e0b1f service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:42.494142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba722907-45e7-4e75-a78b-657548c4a792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:42.495800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722907-45e7-4e75-a78b-657548c4a792 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:42.496084 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722907-45e7-4e75-a78b-657548c4a792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:42.496417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722907-45e7-4e75-a78b-657548c4a792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:42.498367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ba722907-45e7-4e75-a78b-657548c4a792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:42.546217 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba722907-45e7-4e75-a78b-657548c4a792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:42.547756 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba722907-45e7-4e75-a78b-657548c4a792 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:42.557360 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1343/2679] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:42.688860 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c5c7f-568b-410c-8de6-d485fbffa03e None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:42.689430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c5c7f-568b-410c-8de6-d485fbffa03e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:42.689430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c5c7f-568b-410c-8de6-d485fbffa03e None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:42.690754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1337/2680] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:36:42.697055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c653-8d8b-4bd3-8ff1-92095d3c6e8c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:42.697376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c653-8d8b-4bd3-8ff1-92095d3c6e8c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:42.697650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c653-8d8b-4bd3-8ff1-92095d3c6e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:42.741524 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ae52c653-8d8b-4bd3-8ff1-92095d3c6e8c None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:42.742775 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ae52c653-8d8b-4bd3-8ff1-92095d3c6e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:42.775018 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1344/2681] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:36:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:42.788963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c5c7f-568b-410c-8de6-d485fbffa03e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:42.790748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-314c5c7f-568b-410c-8de6-d485fbffa03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:42.804825 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c5c7f-568b-410c-8de6-d485fbffa03e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:42.808651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768dee5-be7e-42bb-9e3c-f97bf4af5021 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:42.809271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768dee5-be7e-42bb-9e3c-f97bf4af5021 service glance] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:42.809557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768dee5-be7e-42bb-9e3c-f97bf4af5021 service glance] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:42.809805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768dee5-be7e-42bb-9e3c-f97bf4af5021 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:42.823730 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768dee5-be7e-42bb-9e3c-f97bf4af5021 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:42.826234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768dee5-be7e-42bb-9e3c-f97bf4af5021 service glance] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:42.842608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1338/2682] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:42.914783 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c36f8-1ae3-460e-a285-dc253cb2aa83 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:42.915104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c36f8-1ae3-460e-a285-dc253cb2aa83 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:42.915380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c36f8-1ae3-460e-a285-dc253cb2aa83 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:42.916747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1345/2683] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:36:42.921816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9d857-fd74-45cb-a017-46ecd5305932 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:42.922031 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9d857-fd74-45cb-a017-46ecd5305932 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:42.922295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9d857-fd74-45cb-a017-46ecd5305932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:42.943505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2dc9d857-fd74-45cb-a017-46ecd5305932 None None] MFA Rules not processed for user `9308f360df864174967889252718bc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:42.944707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2dc9d857-fd74-45cb-a017-46ecd5305932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:42.952752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1339/2684] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:36:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:42.964637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c36f8-1ae3-460e-a285-dc253cb2aa83 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:42.966795 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e65c36f8-1ae3-460e-a285-dc253cb2aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:42.981618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c36f8-1ae3-460e-a285-dc253cb2aa83 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:42.985919 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ee5c1-fbd0-42f6-a817-0c452a1a0835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:42.986506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee5c1-fbd0-42f6-a817-0c452a1a0835 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:42.986781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee5c1-fbd0-42f6-a817-0c452a1a0835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:42.987060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee5c1-fbd0-42f6-a817-0c452a1a0835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:42.994694 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ee5c1-fbd0-42f6-a817-0c452a1a0835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:42.996231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ee5c1-fbd0-42f6-a817-0c452a1a0835 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:43.003979 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1346/2685] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:36:43.086630 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e4a1-9612-4583-84ef-f533b4791a8a None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:43.086960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e4a1-9612-4583-84ef-f533b4791a8a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:43.087218 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e4a1-9612-4583-84ef-f533b4791a8a None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:43.088570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1340/2686] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:36:43.094337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:43.094630 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:43.094936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:43.114943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:43.116160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:43.126158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1347/2687] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:36:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:43.136529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e4a1-9612-4583-84ef-f533b4791a8a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:43.149205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e4a1-9612-4583-84ef-f533b4791a8a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:43.153467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a908b-9a86-4b4f-91b6-f67f90da3f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:43.154252 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a908b-9a86-4b4f-91b6-f67f90da3f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:43.154524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a908b-9a86-4b4f-91b6-f67f90da3f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:43.154784 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a908b-9a86-4b4f-91b6-f67f90da3f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:43.166529 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a908b-9a86-4b4f-91b6-f67f90da3f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:43.168000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a908b-9a86-4b4f-91b6-f67f90da3f7f service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:43.179582 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1341/2688] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:43.244682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:43.246332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:43.317641 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5cb53-50a9-4a4e-8508-cbfa1b50a9c0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:43.324205 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:43.324809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:43.325081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:43.325350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:43.327352 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:43.338944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:43.340564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:43.350501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1348/2689] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:45.705924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44912e1-2814-4dbf-9e70-9ef793c2069d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:45.706419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44912e1-2814-4dbf-9e70-9ef793c2069d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:45.706419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44912e1-2814-4dbf-9e70-9ef793c2069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:45.727158 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d44912e1-2814-4dbf-9e70-9ef793c2069d None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:45.728963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d44912e1-2814-4dbf-9e70-9ef793c2069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:45.739021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1342/2690] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:36:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:45.751280 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:45.763388 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4c61-aa49-4c5f-b0b7-af7d43ac9795 service placement] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:45.769917 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb78c4-f4dc-457c-b98e-63af30653c48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:45.770498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb78c4-f4dc-457c-b98e-63af30653c48 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:45.770810 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb78c4-f4dc-457c-b98e-63af30653c48 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:45.771119 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb78c4-f4dc-457c-b98e-63af30653c48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:45.780021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb78c4-f4dc-457c-b98e-63af30653c48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:45.781626 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb78c4-f4dc-457c-b98e-63af30653c48 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:45.790040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1349/2691] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:36:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:36:47.084861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44912e1-2814-4dbf-9e70-9ef793c2069d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:47.168189 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44912e1-2814-4dbf-9e70-9ef793c2069d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:47.173047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:47.173710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:47.173980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:47.174245 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] PATH_INFO: `/v3/users/9e259cb9dfa444639c289345482cf76f` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:47.175474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e259cb9dfa444639c289345482cf76f)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:47.177409 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:47.230571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e259cb9dfa444639c289345482cf76f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.241411 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e259cb9dfa444639c289345482cf76f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.256299 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e259cb9dfa444639c289345482cf76f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.257056 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e259cb9dfa444639c289345482cf76f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.257645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e259cb9dfa444639c289345482cf76f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.269687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1343/2692] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:47 2022] DELETE /identity/v3/users/9e259cb9dfa444639c289345482cf76f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:47.274462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:47.274981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:47.275121 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:47.294701 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=100 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:47.319858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:47.321729 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:47.383841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1350/2693] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:47.393649 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:47.395135 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:47.425648 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:47.459836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde149-f66d-4684-a3c5-d4ed8fc0e65c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:47.464535 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e373d-45dd-46a4-96ff-7fdf66d7844a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:47.465744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e373d-45dd-46a4-96ff-7fdf66d7844a service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:47.466187 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e373d-45dd-46a4-96ff-7fdf66d7844a service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:47.466629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e373d-45dd-46a4-96ff-7fdf66d7844a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:47.481514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e373d-45dd-46a4-96ff-7fdf66d7844a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:47.483779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e373d-45dd-46a4-96ff-7fdf66d7844a service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:47.498613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1344/2694] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:47.807975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:47.809494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:47.822573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c08c2-9005-41c7-a7b4-f161be8e6f86 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:47.828435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:47.829399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:47.829671 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:47.829936 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] PATH_INFO: `/v3/projects/95e97b1f02a942448d0d64e35085875c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:47.831083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e97b1f02a942448d0d64e35085875c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:47.833720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:47.890104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e97b1f02a942448d0d64e35085875c', 'request_id': 'req-182989db-fc7b-407d-ba04-8ceee21d0787'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.898884 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e97b1f02a942448d0d64e35085875c', 'request_id': 'req-182989db-fc7b-407d-ba04-8ceee21d0787'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.908460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e97b1f02a942448d0d64e35085875c', 'request_id': 'req-182989db-fc7b-407d-ba04-8ceee21d0787'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.932195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] The token cache is being invalidate because project 95e97b1f02a942448d0d64e35085875c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:47.932529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.933184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-182989db-fc7b-407d-ba04-8ceee21d0787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:47.935143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1351/2695] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:47 2022] DELETE /identity/v3/projects/95e97b1f02a942448d0d64e35085875c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:47.940139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e87747-ce43-4073-8f60-69bfcad7fdab None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:47.940548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e87747-ce43-4073-8f60-69bfcad7fdab None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:47.940914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e87747-ce43-4073-8f60-69bfcad7fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:47.983917 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-13e87747-ce43-4073-8f60-69bfcad7fdab None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:47.985313 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-13e87747-ce43-4073-8f60-69bfcad7fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:48.049208 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1345/2696] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:48.057385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd2d47-2491-4b74-953a-2a08b5d69244 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.057659 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd2d47-2491-4b74-953a-2a08b5d69244 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.057928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd2d47-2491-4b74-953a-2a08b5d69244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.078687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-babd2d47-2491-4b74-953a-2a08b5d69244 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:48.080001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-babd2d47-2491-4b74-953a-2a08b5d69244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:48.087943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1352/2697] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:48.092337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e87747-ce43-4073-8f60-69bfcad7fdab None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:48.102483 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e87747-ce43-4073-8f60-69bfcad7fdab None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:48.107007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:48.107627 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.107908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.108177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.108833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:48.109160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:48.110753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:48.124203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1346/2698] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:36:48.128680 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd2d47-2491-4b74-953a-2a08b5d69244 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:48.138411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd2d47-2491-4b74-953a-2a08b5d69244 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:48.143369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:48.144446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.144446 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.144896 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.145597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:48.147619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:48.197890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1353/2699] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:48 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:36:48.202490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:48.215844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf14b-40de-42e0-a8cc-e225e7e0cf0f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:48.275336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:48.276353 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.276811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.277275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.278088 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:48.280268 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:48.304217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1347/2700] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:48 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:36:48.308401 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:48.319010 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263cfc4-377d-4f6a-8554-d99f051654c3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:48.330863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:48.330863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.330863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.330863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.331355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:48.331355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:48.339639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1354/2701] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:36:48.344425 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:48.357351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de259d-efac-4bad-80bd-2fc88dbb1d62 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:48.362962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88fc60-c021-4aa7-a43c-b029e237188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:48.363592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88fc60-c021-4aa7-a43c-b029e237188e admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.363870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88fc60-c021-4aa7-a43c-b029e237188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.364148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88fc60-c021-4aa7-a43c-b029e237188e admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.364793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88fc60-c021-4aa7-a43c-b029e237188e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:48.366605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88fc60-c021-4aa7-a43c-b029e237188e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:48.378565 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1348/2702] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:36:48.383317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:48.393342 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2ebf4-01d0-48af-bb07-f16094b020fb admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:48.397878 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:48.398528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.398854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.399098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] PATH_INFO: `/v3/projects/1ad53849b05d4da388fcff41eae60f32/users/bd8571cb2327458aa576146bc95e396e/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.419959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad53849b05d4da388fcff41eae60f32, user_id=bd8571cb2327458aa576146bc95e396e, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:48.424157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:48.441898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1355/2703] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:36:48 2022] PUT /identity/v3/projects/1ad53849b05d4da388fcff41eae60f32/users/bd8571cb2327458aa576146bc95e396e/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:36:48.454311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899490-4385-4665-9ac5-79569f834337 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.454585 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899490-4385-4665-9ac5-79569f834337 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.454892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899490-4385-4665-9ac5-79569f834337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.485723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-59899490-4385-4665-9ac5-79569f834337 None None] MFA Rules not processed for user `bd8571cb2327458aa576146bc95e396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:48.486967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-59899490-4385-4665-9ac5-79569f834337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:48.491343 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:48.561910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1349/2704] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:48.573198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:48.575056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:48.585777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:48.671964 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bf38b-d4cb-4ea4-8168-629502682abf admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:48.676346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5576d9e-efee-4cca-ba70-6ae8d7ad7b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:48.677025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576d9e-efee-4cca-ba70-6ae8d7ad7b06 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:48.677337 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576d9e-efee-4cca-ba70-6ae8d7ad7b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:48.677606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576d9e-efee-4cca-ba70-6ae8d7ad7b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:48.687111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5576d9e-efee-4cca-ba70-6ae8d7ad7b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:48.688668 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5576d9e-efee-4cca-ba70-6ae8d7ad7b06 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:48.699054 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1356/2705] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:58.559213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=25 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:58.694277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=32 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:58.971415 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59899490-4385-4665-9ac5-79569f834337 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:59.034746 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59899490-4385-4665-9ac5-79569f834337 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:59.040349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:59.040973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.041244 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.041520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] PATH_INFO: `/v3/users/bd8571cb2327458aa576146bc95e396e` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.042743 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8571cb2327458aa576146bc95e396e)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:59.044788 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:59.092042 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8571cb2327458aa576146bc95e396e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.100473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8571cb2327458aa576146bc95e396e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.112378 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8571cb2327458aa576146bc95e396e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.113024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8571cb2327458aa576146bc95e396e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.113628 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8571cb2327458aa576146bc95e396e'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.126111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1350/2706] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:36:58 2022] DELETE /identity/v3/users/bd8571cb2327458aa576146bc95e396e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:59.130869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.131158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.131422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.151990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:59.153216 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:59.225042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1357/2707] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:59.235089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:59.236554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:59.300054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabf628-bc05-4e09-bbbf-afbc7d174fc8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:59.304429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b4b9b-5834-4982-8007-8321750dee10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:59.305125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b4b9b-5834-4982-8007-8321750dee10 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.305306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b4b9b-5834-4982-8007-8321750dee10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.305573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b4b9b-5834-4982-8007-8321750dee10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.315253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b4b9b-5834-4982-8007-8321750dee10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:59.316683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b4b9b-5834-4982-8007-8321750dee10 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:59.326866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1351/2708] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:36:59.627904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:59.633118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:59.657498 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1a601-6957-4c4f-a270-1886b33e6edf None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:59.664733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:59.667354 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.667864 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.668345 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] PATH_INFO: `/v3/projects/1ad53849b05d4da388fcff41eae60f32` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.670003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad53849b05d4da388fcff41eae60f32)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:59.672278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:59.734933 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad53849b05d4da388fcff41eae60f32', 'request_id': 'req-5d351b5e-e7e4-44e7-9af3-128f9c394c05'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.742251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad53849b05d4da388fcff41eae60f32', 'request_id': 'req-5d351b5e-e7e4-44e7-9af3-128f9c394c05'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.752274 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad53849b05d4da388fcff41eae60f32', 'request_id': 'req-5d351b5e-e7e4-44e7-9af3-128f9c394c05'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.765542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] The token cache is being invalidate because project 1ad53849b05d4da388fcff41eae60f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:36:59.765827 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.766460 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-5d351b5e-e7e4-44e7-9af3-128f9c394c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:36:59.768608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1358/2709] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:36:59 2022] DELETE /identity/v3/projects/1ad53849b05d4da388fcff41eae60f32 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:36:59.773718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a925d-981c-401a-880d-2d310d74c3c1 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.774202 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a925d-981c-401a-880d-2d310d74c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.774312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a925d-981c-401a-880d-2d310d74c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.793439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-341a925d-981c-401a-880d-2d310d74c3c1 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:59.794714 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-341a925d-981c-401a-880d-2d310d74c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:59.811667 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:59.855578 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1352/2710] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:36:59.863757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547e163-bc31-401b-87c6-c1e030037a88 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.864027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547e163-bc31-401b-87c6-c1e030037a88 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.864298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547e163-bc31-401b-87c6-c1e030037a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.884794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f547e163-bc31-401b-87c6-c1e030037a88 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:36:59.886025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f547e163-bc31-401b-87c6-c1e030037a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:36:59.895529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1359/2711] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:36:59.900407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a925d-981c-401a-880d-2d310d74c3c1 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:59.914111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a925d-981c-401a-880d-2d310d74c3c1 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:59.919741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:59.920341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.920609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.920876 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.921517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:36:59.921819 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:59.923442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:59.935229 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1353/2712] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:36:59.939560 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547e163-bc31-401b-87c6-c1e030037a88 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:36:59.949276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547e163-bc31-401b-87c6-c1e030037a88 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:36:59.954413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:36:59.955049 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:36:59.955320 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:36:59.955589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:36:59.956236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:36:59.958124 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:36:59.988110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1360/2713] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:36:59 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:36:59.991586 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:00.001811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbe10-a918-4b75-b5d2-3abccec61fcb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:00.059990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:00.060596 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:00.060870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:00.061247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:00.061960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:00.063908 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:00.091655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1354/2714] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:36:59 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:37:00.095829 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:00.106721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4cae8-8e9b-40fb-95c0-a45ba03f85df admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:00.115008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:00.115635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:00.115908 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:00.116196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:00.116830 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:00.118443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:00.129384 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1361/2715] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:37:00.133893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:00.144491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11876-8485-4561-8edf-2cfb6e61cd98 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:00.150429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39af22a-e41e-41ac-ab60-964b8d7d3047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:00.151456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39af22a-e41e-41ac-ab60-964b8d7d3047 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:00.151731 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39af22a-e41e-41ac-ab60-964b8d7d3047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:00.152002 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39af22a-e41e-41ac-ab60-964b8d7d3047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:00.152646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39af22a-e41e-41ac-ab60-964b8d7d3047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:00.154233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39af22a-e41e-41ac-ab60-964b8d7d3047 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:00.165303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1355/2716] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:37:00.169541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:00.179921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a8e4-8932-47aa-9a1c-9fcadfeb4351 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:00.185777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:00.186484 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:00.186767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:00.187072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] PATH_INFO: `/v3/projects/510f20d706b94f3abe022ec674f2e390/users/f32f04071346495ea404c9441da08a69/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:00.202777 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510f20d706b94f3abe022ec674f2e390, user_id=f32f04071346495ea404c9441da08a69, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:00.205632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:00.220129 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1362/2717] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:37:00 2022] PUT /identity/v3/projects/510f20d706b94f3abe022ec674f2e390/users/f32f04071346495ea404c9441da08a69/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:37:00.225379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9f7f-c4f0-4b17-a34d-32b9fa655241 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:00.225687 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9f7f-c4f0-4b17-a34d-32b9fa655241 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:00.225958 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9f7f-c4f0-4b17-a34d-32b9fa655241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:00.245177 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-936f9f7f-c4f0-4b17-a34d-32b9fa655241 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:00.246312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-936f9f7f-c4f0-4b17-a34d-32b9fa655241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:00.304053 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1356/2718] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:00.313886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:00.315893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:00.339456 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:37:00.376051 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c32d-1158-4647-ac85-ee221b9e5107 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:00.379822 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:00.380420 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:00.380696 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:00.380959 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:00.390026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:00.391522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:00.400974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1363/2719] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:01.047359 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ecfd1-c15b-41b0-9f6c-b5cf8dc7a9fb None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:01.047897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ecfd1-c15b-41b0-9f6c-b5cf8dc7a9fb None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:01.047897 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ecfd1-c15b-41b0-9f6c-b5cf8dc7a9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:01.077894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-a40ecfd1-c15b-41b0-9f6c-b5cf8dc7a9fb None None] MFA Rules not processed for user `f32f04071346495ea404c9441da08a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:01.079160 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a40ecfd1-c15b-41b0-9f6c-b5cf8dc7a9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:01.097116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:37:01.149085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1357/2720] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:37:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:01.159988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:01.161513 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:01.227490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25bfe8-d607-4a2f-8a60-f73ab077a4fb service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:01.231424 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:01.232042 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:01.232307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:01.232580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:01.241165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:01.242616 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:01.251954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1364/2721] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:01.846550 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522ff6-5ee3-41f1-90a5-0d66bdd417c4 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:01.846847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522ff6-5ee3-41f1-90a5-0d66bdd417c4 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:01.847165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522ff6-5ee3-41f1-90a5-0d66bdd417c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:01.866495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-99522ff6-5ee3-41f1-90a5-0d66bdd417c4 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:01.867809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-99522ff6-5ee3-41f1-90a5-0d66bdd417c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:01.925636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1358/2722] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 15 07:37:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:01.938197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:01.939849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:02.009638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e421-789f-487a-ae4d-96dfcb45e851 service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:02.015152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00143f0-d19f-4795-8fe4-2f6a5d5a0231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:02.015767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00143f0-d19f-4795-8fe4-2f6a5d5a0231 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:02.016047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00143f0-d19f-4795-8fe4-2f6a5d5a0231 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:02.016317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00143f0-d19f-4795-8fe4-2f6a5d5a0231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:02.024918 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00143f0-d19f-4795-8fe4-2f6a5d5a0231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:02.026532 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00143f0-d19f-4795-8fe4-2f6a5d5a0231 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:02.035208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1365/2723] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:37:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:37:02.625503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:02.626065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:02.626065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:02.645344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] MFA Rules not processed for user `f32f04071346495ea404c9441da08a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:02.646600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:02.653738 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1359/2724] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:37:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:12.031533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=75 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:37:12.639859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=47 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:37:28.936526 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd17-ecf0-4f24-86af-c958df88efd8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:28.937158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd17-ecf0-4f24-86af-c958df88efd8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:28.937158 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd17-ecf0-4f24-86af-c958df88efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:28.961753 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-d0cffd17-ecf0-4f24-86af-c958df88efd8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:28.963021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d0cffd17-ecf0-4f24-86af-c958df88efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:28.973077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1366/2725] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:29.005070 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:29.006644 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:29.097495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434d4a4-4e4d-48bf-b43c-15b0ffdc5d49 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:29.103201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:29.103843 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:29.104116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:29.104388 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:29.113043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:29.114716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:29.124093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1360/2726] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:32.030171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576529be-096a-4bb6-a77f-70f739231943 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:32.030726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576529be-096a-4bb6-a77f-70f739231943 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:32.030726 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576529be-096a-4bb6-a77f-70f739231943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:32.051034 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-576529be-096a-4bb6-a77f-70f739231943 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:32.052249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-576529be-096a-4bb6-a77f-70f739231943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:32.061784 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1367/2727] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:32.083793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:32.095804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eeab1-f95d-45f5-81e1-a5d30aea24e6 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:32.102569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:32.103623 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:32.103956 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:32.104309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:32.117520 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:32.120054 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:32.132900 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1361/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:35.303038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e747cf-c1cc-4ff7-8f9f-ff4ef9fc4281 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:35.303589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e747cf-c1cc-4ff7-8f9f-ff4ef9fc4281 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:35.303589 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e747cf-c1cc-4ff7-8f9f-ff4ef9fc4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:35.324166 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-71e747cf-c1cc-4ff7-8f9f-ff4ef9fc4281 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:35.325359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-71e747cf-c1cc-4ff7-8f9f-ff4ef9fc4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:35.334866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1368/2729] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:35.353215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:35.354752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:35.369521 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf451ce1-4a58-4752-81f0-3fd85b4603d9 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:35.376294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:35.376888 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:35.377154 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:35.377414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:35.386363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:35.388085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:35.397883 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1362/2730] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:38.400561 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008c188-3e96-44c0-8cae-dc30c588582b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:38.401044 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008c188-3e96-44c0-8cae-dc30c588582b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:38.401160 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008c188-3e96-44c0-8cae-dc30c588582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:38.420533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4008c188-3e96-44c0-8cae-dc30c588582b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:38.421712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4008c188-3e96-44c0-8cae-dc30c588582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:38.430064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1369/2731] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:38.445980 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:38.457906 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334f13-09fc-4724-8eac-fb1d44c39f46 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:38.464524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:38.465139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:38.465414 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:38.465677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:38.474854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:38.476455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:38.486275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1363/2732] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:41.605231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50505b3-a57a-49db-b456-7c9be0707d05 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:41.606081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50505b3-a57a-49db-b456-7c9be0707d05 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:41.606081 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50505b3-a57a-49db-b456-7c9be0707d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:41.630422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e50505b3-a57a-49db-b456-7c9be0707d05 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:41.632290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e50505b3-a57a-49db-b456-7c9be0707d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:41.646435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1370/2733] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:41.663223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:41.674639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ba791-e93e-4095-96b8-fce9a285ede4 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:41.681429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:41.682028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:41.682297 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:41.682562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:41.690624 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:41.692237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:41.701686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1364/2734] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:44.776476 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e2a20-e2d8-4634-9a02-f12441471684 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:44.776975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e2a20-e2d8-4634-9a02-f12441471684 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:44.777074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e2a20-e2d8-4634-9a02-f12441471684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:44.796422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-bf3e2a20-e2d8-4634-9a02-f12441471684 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:44.797632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-bf3e2a20-e2d8-4634-9a02-f12441471684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:44.805859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1371/2735] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:44.826672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:44.838312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6189-74c2-4a63-81ac-bb6cdb0560a4 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:44.844324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:44.844922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:44.845335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:44.845595 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:44.854597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:44.856256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:44.866696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1365/2736] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:37:52.224957 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba3fca-ffa9-42c6-b642-25e91bdf6aba None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:52.225487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba3fca-ffa9-42c6-b642-25e91bdf6aba None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:52.225487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba3fca-ffa9-42c6-b642-25e91bdf6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:52.233125 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=19 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:37:52.246222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4cba3fca-ffa9-42c6-b642-25e91bdf6aba None None] MFA Rules not processed for user `97c3c6f420da4209aa68ec0c8c3c543f`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:37:52.247495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4cba3fca-ffa9-42c6-b642-25e91bdf6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:52.301008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1372/2737] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:37:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:37:52.626068 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:37:52.636584 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cda48f-f5ab-4422-979e-757f9d0357c5 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:37:52.641172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc709f80-f7b1-4740-a9a0-e1067e77b071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:37:52.641781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709f80-f7b1-4740-a9a0-e1067e77b071 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:37:52.642046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709f80-f7b1-4740-a9a0-e1067e77b071 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:37:52.642309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709f80-f7b1-4740-a9a0-e1067e77b071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:37:52.644408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-cc709f80-f7b1-4740-a9a0-e1067e77b071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:37:52.651046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=67 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:37:52.655247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc709f80-f7b1-4740-a9a0-e1067e77b071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:37:52.657579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc709f80-f7b1-4740-a9a0-e1067e77b071 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:37:52.665681 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1366/2738] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:37:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:38:01.411447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88d33f-3498-4a45-a2c6-ca11a2657cf0 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:01.412024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88d33f-3498-4a45-a2c6-ca11a2657cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:01.412024 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88d33f-3498-4a45-a2c6-ca11a2657cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:01.432161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-ec88d33f-3498-4a45-a2c6-ca11a2657cf0 None None] MFA Rules not processed for user `f32f04071346495ea404c9441da08a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:38:01.433380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ec88d33f-3498-4a45-a2c6-ca11a2657cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:01.441503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1373/2739] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:38:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:38:02.661983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:11.426373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=27 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:17.159828 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90071-244a-4958-9678-ca73f624552b None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:17.160397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90071-244a-4958-9678-ca73f624552b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:17.160397 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90071-244a-4958-9678-ca73f624552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:17.181303 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d0c90071-244a-4958-9678-ca73f624552b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:38:17.182465 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d0c90071-244a-4958-9678-ca73f624552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:17.190914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1367/2740] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:38:17.207056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88d33f-3498-4a45-a2c6-ca11a2657cf0 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:17.238522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88d33f-3498-4a45-a2c6-ca11a2657cf0 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:17.245015 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:17.245619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:17.245890 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:17.246150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:17.255183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:17.256762 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:17.266767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1374/2741] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:38:20.469513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75bb3f-1f5e-46f7-a74a-64e60602b3da None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:20.470100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75bb3f-1f5e-46f7-a74a-64e60602b3da None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:20.470100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75bb3f-1f5e-46f7-a74a-64e60602b3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:20.490654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6e75bb3f-1f5e-46f7-a74a-64e60602b3da None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:38:20.491863 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6e75bb3f-1f5e-46f7-a74a-64e60602b3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:20.500880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1368/2742] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:38:20.518921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:20.530752 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae82e1-1dbd-4c3c-b8f7-fb6803421a1d service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:20.537261 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:20.537871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:20.538150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:20.538421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:20.547381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:20.548974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:20.558791 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1375/2743] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:38:23.577970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add252-3b0a-49c7-9d7b-59a9fa53965c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:23.578482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add252-3b0a-49c7-9d7b-59a9fa53965c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:23.578482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add252-3b0a-49c7-9d7b-59a9fa53965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:23.599174 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b8add252-3b0a-49c7-9d7b-59a9fa53965c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:38:23.600374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b8add252-3b0a-49c7-9d7b-59a9fa53965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:23.609654 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1369/2744] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:38:23.625355 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:23.637102 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b728b15-9a09-4470-8243-54b1f3716b8d service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:23.643666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:23.644287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:23.644564 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:23.644831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:23.653060 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:23.654667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:23.663926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1376/2745] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:38:26.762075 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb2e2-b101-404c-abf4-bbcba9d5ccb9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:26.762677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb2e2-b101-404c-abf4-bbcba9d5ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:26.762677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb2e2-b101-404c-abf4-bbcba9d5ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:26.784280 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-264cb2e2-b101-404c-abf4-bbcba9d5ccb9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:38:26.785501 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-264cb2e2-b101-404c-abf4-bbcba9d5ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:26.793570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1370/2746] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:38:26.810998 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:26.822610 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc4dec-31d0-4d0a-b2a0-d1d440b7bf39 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:26.828867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:26.829556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:26.829832 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:26.830509 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:26.839374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:26.841183 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:26.851725 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1377/2747] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:38:29.966307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:29.966862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:29.966862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:29.988008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:38:29.989220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:29.999693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1371/2748] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 07:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:38:30.020529 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:30.035225 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25b3c8-4b04-46fb-92bc-bde8dab4af82 service nova] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:30.045062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a379e-3e97-40b8-b6f2-4e87ff8f09ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:30.045679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a379e-3e97-40b8-b6f2-4e87ff8f09ab service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:30.045951 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a379e-3e97-40b8-b6f2-4e87ff8f09ab service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:30.046465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a379e-3e97-40b8-b6f2-4e87ff8f09ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:30.065169 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a379e-3e97-40b8-b6f2-4e87ff8f09ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:30.067966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a379e-3e97-40b8-b6f2-4e87ff8f09ab service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:30.082486 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1378/2749] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:38:31.800116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:31.801832 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:31.899325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85293964-9ba8-4631-a302-be4ea1e6c485 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:31.905081 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:31.905691 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:31.905961 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:31.906227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:31.908289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:31.920138 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:31.921718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:31.931470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1372/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:38:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:38:40.075684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=37 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:41.927210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=56 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:57.203505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:57.203505 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:57.204017 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:57.226127 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:38:57.227743 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:57.238256 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1379/2751] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:38:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:38:57.300716 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:57.312536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cd5ca-e263-454d-8a91-e6d7dc64bd8c service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:57.318435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:57.319387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:57.319880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:57.320363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:57.329220 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:57.330809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:57.339572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1373/2752] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:38:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 07:38:59.185262 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:59.187551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:38:59.212411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756206bd-eaf6-4b43-9dff-8d374ce28769 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:59.217724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:59.218721 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:59.219030 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:59.219299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] PATH_INFO: `/v3/users/fe8048f110944a0683f8d41d3afdaa09` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:59.220463 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8048f110944a0683f8d41d3afdaa09)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:59.222473 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:59.334997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8048f110944a0683f8d41d3afdaa09'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:38:59.360063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8048f110944a0683f8d41d3afdaa09'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:38:59.370549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8048f110944a0683f8d41d3afdaa09'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:38:59.372269 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8048f110944a0683f8d41d3afdaa09'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:38:59.402760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8048f110944a0683f8d41d3afdaa09'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:38:59.434164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1380/2753] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:38:59 2022] DELETE /identity/v3/users/fe8048f110944a0683f8d41d3afdaa09 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:38:59.779723 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:59.792198 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c231e07-48bd-4f9c-b58a-d46ca422d77f service swift] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:38:59.903119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:38:59.904253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:38:59.904854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:38:59.905314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] PATH_INFO: `/v3/projects/243a3746d7db4181b75f85e0e1f6b5e9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:38:59.906659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243a3746d7db4181b75f85e0e1f6b5e9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:38:59.909168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:38:59.983644 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:38:59.985339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:00.006885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48896dda-4ce5-46d4-8b5c-400536671083 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:00.016241 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243a3746d7db4181b75f85e0e1f6b5e9', 'request_id': 'req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.029261 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243a3746d7db4181b75f85e0e1f6b5e9', 'request_id': 'req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.037695 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243a3746d7db4181b75f85e0e1f6b5e9', 'request_id': 'req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.054809 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] The token cache is being invalidate because project 243a3746d7db4181b75f85e0e1f6b5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:39:00.055475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.056676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.058842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1374/2754] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:38:59 2022] DELETE /identity/v3/projects/243a3746d7db4181b75f85e0e1f6b5e9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:39:00.063024 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:00.064941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:00.108243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:00.110046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:00.110489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:00.111443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] PATH_INFO: `/v3/users/f32f04071346495ea404c9441da08a69` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:00.113199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32f04071346495ea404c9441da08a69)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:00.116272 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:00.163733 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a44c-dccc-42d1-81de-1e1bc7ec0516 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:00.175007 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:00.176486 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:00.177575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:00.178456 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] PATH_INFO: `/v3/users/e6147f96ddfe414895cba8567b7c6026` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:00.180674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6147f96ddfe414895cba8567b7c6026)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:00.183096 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:00.215817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:00.222033 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32f04071346495ea404c9441da08a69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.235003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32f04071346495ea404c9441da08a69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.236185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32f04071346495ea404c9441da08a69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.237433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32f04071346495ea404c9441da08a69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.259594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6147f96ddfe414895cba8567b7c6026'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.260383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32f04071346495ea404c9441da08a69'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.271706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6147f96ddfe414895cba8567b7c6026'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.273517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:00.287656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6147f96ddfe414895cba8567b7c6026'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.288569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6147f96ddfe414895cba8567b7c6026'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.289128 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6147f96ddfe414895cba8567b7c6026'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.302865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1375/2755] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:39:00 2022] DELETE /identity/v3/users/e6147f96ddfe414895cba8567b7c6026 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:39:00.303724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1381/2756] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:38:59 2022] DELETE /identity/v3/users/f32f04071346495ea404c9441da08a69 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:39:00.660818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:00.662739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:00.688667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:00.690118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:00.800845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa0cf-9f8b-40e3-84ba-2af2a1b31a55 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:00.806311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:00.807076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:00.807617 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:00.807993 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] PATH_INFO: `/v3/projects/510f20d706b94f3abe022ec674f2e390` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:00.808219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e057ef-dab5-4b9d-9715-469f2cc6aa64 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:00.809300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=510f20d706b94f3abe022ec674f2e390)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:00.811523 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:00.813946 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:00.814781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:00.815230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:00.815675 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] PATH_INFO: `/v3/projects/520f4dfc8a004ea0bb0adb524c8a87dd` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:00.817282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520f4dfc8a004ea0bb0adb524c8a87dd)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:00.819394 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:00.872165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510f20d706b94f3abe022ec674f2e390', 'request_id': 'req-6d8206f4-f35b-4d81-88c3-de8c5025be2f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.879400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520f4dfc8a004ea0bb0adb524c8a87dd', 'request_id': 'req-19abc5ec-c0c3-468a-9953-7bb263b15311'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.885899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510f20d706b94f3abe022ec674f2e390', 'request_id': 'req-6d8206f4-f35b-4d81-88c3-de8c5025be2f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.886639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520f4dfc8a004ea0bb0adb524c8a87dd', 'request_id': 'req-19abc5ec-c0c3-468a-9953-7bb263b15311'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.896458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510f20d706b94f3abe022ec674f2e390', 'request_id': 'req-6d8206f4-f35b-4d81-88c3-de8c5025be2f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.898019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520f4dfc8a004ea0bb0adb524c8a87dd', 'request_id': 'req-19abc5ec-c0c3-468a-9953-7bb263b15311'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.912975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] The token cache is being invalidate because project 510f20d706b94f3abe022ec674f2e390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:39:00.913677 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.915035 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-6d8206f4-f35b-4d81-88c3-de8c5025be2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.915692 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] The token cache is being invalidate because project 520f4dfc8a004ea0bb0adb524c8a87dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:39:00.916000 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.916627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-19abc5ec-c0c3-468a-9953-7bb263b15311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:39:00.931245 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1382/2758] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:39:00 2022] DELETE /identity/v3/projects/520f4dfc8a004ea0bb0adb524c8a87dd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:39:00.931698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1376/2758] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:39:00 2022] DELETE /identity/v3/projects/510f20d706b94f3abe022ec674f2e390 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:39:10.908308 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=15,keystone:SELECT=71,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:10.912760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:DELETE=9,keystone:SELECT=56,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:12.494443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88758790-11b0-4b7f-a3c6-1d8ad3b2be78 None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:12.495229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88758790-11b0-4b7f-a3c6-1d8ad3b2be78 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:12.495229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88758790-11b0-4b7f-a3c6-1d8ad3b2be78 None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:12.496350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1383/2759] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:39:12.502757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123073-5196-49bb-8578-6866fc4d4431 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:12.503656 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123073-5196-49bb-8578-6866fc4d4431 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:12.504109 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123073-5196-49bb-8578-6866fc4d4431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:12.536844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b6123073-5196-49bb-8578-6866fc4d4431 None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:39:12.538028 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b6123073-5196-49bb-8578-6866fc4d4431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:12.605518 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1377/2760] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:39:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:39:12.617785 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88758790-11b0-4b7f-a3c6-1d8ad3b2be78 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:12.619613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-88758790-11b0-4b7f-a3c6-1d8ad3b2be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:12.680554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88758790-11b0-4b7f-a3c6-1d8ad3b2be78 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:12.684013 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6360d-45f4-417a-8d26-54f16237a815 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:12.684611 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6360d-45f4-417a-8d26-54f16237a815 service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:12.684892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6360d-45f4-417a-8d26-54f16237a815 service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:12.685192 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6360d-45f4-417a-8d26-54f16237a815 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:12.695843 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6360d-45f4-417a-8d26-54f16237a815 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:12.697298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6360d-45f4-417a-8d26-54f16237a815 service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:12.707914 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1384/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:39:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:39:12.785952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88466a7-41be-4f9f-9738-d24526b1966b None None] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:12.786239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88466a7-41be-4f9f-9738-d24526b1966b None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:12.786512 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88466a7-41be-4f9f-9738-d24526b1966b None None] PATH_INFO: `/` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:12.788018 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1378/2762] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:39:12.793371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e639-2ae1-4517-9bf1-d8eed1331dc7 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:12.793898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e639-2ae1-4517-9bf1-d8eed1331dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:12.794220 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e639-2ae1-4517-9bf1-d8eed1331dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:12.815469 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4a53e639-2ae1-4517-9bf1-d8eed1331dc7 None None] MFA Rules not processed for user `9308f360df864174967889252718bc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:39:12.817087 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4a53e639-2ae1-4517-9bf1-d8eed1331dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:12.874687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1385/2763] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:39:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:39:12.887589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88466a7-41be-4f9f-9738-d24526b1966b None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:12.890304 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d88466a7-41be-4f9f-9738-d24526b1966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:12.907977 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88466a7-41be-4f9f-9738-d24526b1966b None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:12.912044 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0ff7-daa9-496c-b5c2-c0a463fd512a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:12.912639 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0ff7-daa9-496c-b5c2-c0a463fd512a service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:12.912907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0ff7-daa9-496c-b5c2-c0a463fd512a service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:12.913171 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0ff7-daa9-496c-b5c2-c0a463fd512a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:12.920327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e0ff7-daa9-496c-b5c2-c0a463fd512a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:12.921741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e0ff7-daa9-496c-b5c2-c0a463fd512a service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:12.929405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1379/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:39:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:39:13.018854 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef8bd8-4a06-4d47-b063-0ca13d6dbf4e None None] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:13.019138 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef8bd8-4a06-4d47-b063-0ca13d6dbf4e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:13.019408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef8bd8-4a06-4d47-b063-0ca13d6dbf4e None None] PATH_INFO: `/` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:13.020942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1386/2765] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 15 07:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 07:39:13.026561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70090866-bd79-41ea-8690-a86b5ee594ce None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:13.026815 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70090866-bd79-41ea-8690-a86b5ee594ce None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:13.027137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70090866-bd79-41ea-8690-a86b5ee594ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:13.048314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-70090866-bd79-41ea-8690-a86b5ee594ce None None] MFA Rules not processed for user `ded85d4044b1442d95e53c859459738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:39:13.049475 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-70090866-bd79-41ea-8690-a86b5ee594ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:13.060481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1380/2766] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 15 07:39:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:39:13.071679 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef8bd8-4a06-4d47-b063-0ca13d6dbf4e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:13.073538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-2aef8bd8-4a06-4d47-b063-0ca13d6dbf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:13.088434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef8bd8-4a06-4d47-b063-0ca13d6dbf4e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:13.092196 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:13.092794 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:13.093067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:13.093333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:13.103623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:13.105061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:13.115389 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1387/2767] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:39:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:39:14.923682 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216cda-277e-4040-a28b-3a47fee1b943 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:14.924210 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216cda-277e-4040-a28b-3a47fee1b943 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:14.924325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216cda-277e-4040-a28b-3a47fee1b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:14.945377 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-df216cda-277e-4040-a28b-3a47fee1b943 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:39:14.946992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-df216cda-277e-4040-a28b-3a47fee1b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:15.002102 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1381/2768] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:39:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:39:15.014547 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:15.016097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:15.089304 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1e56-da2a-4c7e-831b-82198f66921c service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:15.095264 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:15.095867 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:15.096148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:15.096416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:15.105317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:15.106947 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:15.115130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1388/2769] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:39:24.995325 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=70 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:25.111897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=87 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:33.884148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:33.884613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:33.884613 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:33.904562 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:39:33.905920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:39:33.913674 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1382/2770] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 15 07:39:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:39:33.926229 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:39:33.937525 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff40ac3-2e49-4df7-a691-b7daaf0edb60 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:39:33.944287 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:39:33.944886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:39:33.945167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:39:33.945428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:39:33.953736 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:39:33.955385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:39:33.964623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1389/2771] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:39:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:39:43.899276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:43.960483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=6 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:09.454172 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:09.456853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:09.480446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b16c3-30df-488a-87d7-ff3d96d1f9ec None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:09.487234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:09.487854 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:09.488127 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:09.488392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:09.490265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:09.550790 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:09.552460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:09.561495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1383/2772] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:15.026441 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:15.036053 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1045996-fcd9-491a-ad9d-d20cde983c62 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:15.040020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:15.040613 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:15.040883 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:15.041144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:15.043050 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:15.108353 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:15.109808 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:15.120988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1390/2773] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:18.533030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:18.534537 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:18.548745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36551054-9337-4ca0-b3b6-340e671f4547 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:18.553969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:18.554853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:18.555132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:18.555401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] PATH_INFO: `/v3/users/97c3c6f420da4209aa68ec0c8c3c543f` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:18.556604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c3c6f420da4209aa68ec0c8c3c543f)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:18.558688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:18.607528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c3c6f420da4209aa68ec0c8c3c543f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.616023 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c3c6f420da4209aa68ec0c8c3c543f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.629858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c3c6f420da4209aa68ec0c8c3c543f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.630690 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c3c6f420da4209aa68ec0c8c3c543f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.631548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-a7d53ffa-a404-4756-a675-dc9dac251346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c3c6f420da4209aa68ec0c8c3c543f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.644963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1384/2774] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:40:18 2022] DELETE /identity/v3/users/97c3c6f420da4209aa68ec0c8c3c543f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:18.843373 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:18.854599 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9532-6f90-46f8-ac51-5458e9db587a service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:18.911615 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:18.912243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:18.912523 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:18.912796 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] PATH_INFO: `/v3/projects/eb86744c38c149caa782881e8689f2f5` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:18.913981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb86744c38c149caa782881e8689f2f5)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:18.915986 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:18.965235 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb86744c38c149caa782881e8689f2f5', 'request_id': 'req-40a23be3-e066-4551-90bd-0a3be2d7a6df'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.971038 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb86744c38c149caa782881e8689f2f5', 'request_id': 'req-40a23be3-e066-4551-90bd-0a3be2d7a6df'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.979318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb86744c38c149caa782881e8689f2f5', 'request_id': 'req-40a23be3-e066-4551-90bd-0a3be2d7a6df'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.990006 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] The token cache is being invalidate because project eb86744c38c149caa782881e8689f2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:40:18.990307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.990981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-40a23be3-e066-4551-90bd-0a3be2d7a6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:18.992492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1391/2775] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:40:18 2022] DELETE /identity/v3/projects/eb86744c38c149caa782881e8689f2f5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:18.997534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed2885-7030-498b-a98c-0d401b0fc8e5 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:18.997817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed2885-7030-498b-a98c-0d401b0fc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:18.998093 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed2885-7030-498b-a98c-0d401b0fc8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.018663 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-00ed2885-7030-498b-a98c-0d401b0fc8e5 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:19.019920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-00ed2885-7030-498b-a98c-0d401b0fc8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:19.089991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1385/2776] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:40:19.099300 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a9651-d385-42a5-ae90-ab22db7ed28c None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.099581 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a9651-d385-42a5-ae90-ab22db7ed28c None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.099849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a9651-d385-42a5-ae90-ab22db7ed28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.122105 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6f9a9651-d385-42a5-ae90-ab22db7ed28c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:19.123744 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6f9a9651-d385-42a5-ae90-ab22db7ed28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:19.132859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1392/2777] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:19.137327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed2885-7030-498b-a98c-0d401b0fc8e5 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.147235 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed2885-7030-498b-a98c-0d401b0fc8e5 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.152568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.153206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.153482 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.153747 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.154395 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:40:19.154699 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.156352 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.163228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:19.169928 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1386/2778] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:40:19.174869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a9651-d385-42a5-ae90-ab22db7ed28c None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.184317 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a9651-d385-42a5-ae90-ab22db7ed28c None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.190107 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.191108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.191380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.191645 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.192283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.194199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.210738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:19.225492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1393/2779] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:19 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:40:19.229865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.240094 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2859a-395b-4e8b-b893-408e4e2f5724 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.300851 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.301464 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.301740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.302011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.302646 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.304750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.326374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1387/2780] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:19 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:19.330703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.341371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9349-7b6d-49df-880a-335273e04ad4 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.345981 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.346587 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.346885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.347157 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.347786 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.349422 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.359458 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1394/2781] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:19.363490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.375249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77215-9014-4706-bf03-7db1a4c35e9b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.379869 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d4d9-ceb7-44c7-9e20-6289455ad268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.380526 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d4d9-ceb7-44c7-9e20-6289455ad268 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.380796 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d4d9-ceb7-44c7-9e20-6289455ad268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.381058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d4d9-ceb7-44c7-9e20-6289455ad268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.381694 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d4d9-ceb7-44c7-9e20-6289455ad268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.383346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d4d9-ceb7-44c7-9e20-6289455ad268 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.393813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1388/2782] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:40:19.398395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.408707 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fb9b8-3067-47f1-b54b-9d5cab34f59c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.413646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.414306 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.414572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.414892 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] PATH_INFO: `/v3/projects/3287b0dff0674d8f8a72ea4751d8098c/users/733dcfaea56c4c3fae32e6a93cb0d6b5/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.429602 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287b0dff0674d8f8a72ea4751d8098c, user_id=733dcfaea56c4c3fae32e6a93cb0d6b5, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.432362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.448924 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1395/2783] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:19 2022] PUT /identity/v3/projects/3287b0dff0674d8f8a72ea4751d8098c/users/733dcfaea56c4c3fae32e6a93cb0d6b5/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:19.463666 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a3f9f-9e8d-4bb6-abf5-efff2e6e83e9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.463941 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a3f9f-9e8d-4bb6-abf5-efff2e6e83e9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.464203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a3f9f-9e8d-4bb6-abf5-efff2e6e83e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.492038 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-066a3f9f-9e8d-4bb6-abf5-efff2e6e83e9 None None] MFA Rules not processed for user `733dcfaea56c4c3fae32e6a93cb0d6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:19.493247 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-066a3f9f-9e8d-4bb6-abf5-efff2e6e83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:19.560611 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1389/2784] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:19.565361 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.630489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd224f4-1512-4ba9-9cf0-50f790d19cad admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.636392 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.637009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.637290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.637557 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.638191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.640147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.668831 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1396/2785] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:19 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:19.673215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a3f9f-9e8d-4bb6-abf5-efff2e6e83e9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.684314 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a3f9f-9e8d-4bb6-abf5-efff2e6e83e9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.750505 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.751157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.751434 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.751711 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.752349 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.754240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.765364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:19.778178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1390/2786] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:19 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:19.782427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.793121 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bac32-def8-4140-b4af-490bce6e8031 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.798633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.799302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.799588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.799856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.800499 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.802113 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.813167 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1397/2787] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:19.817742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.828036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6deb8-2cb1-4b42-b786-ecfced46d1df admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.832836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.833490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.833763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.834033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] PATH_INFO: `/v3/projects/306b17ff3ec34d96b5d2645b094f192a/users/5b21756c60824b0b8bfb173740936f15/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.848960 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306b17ff3ec34d96b5d2645b094f192a, user_id=5b21756c60824b0b8bfb173740936f15, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.851750 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.866557 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1391/2788] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:19 2022] PUT /identity/v3/projects/306b17ff3ec34d96b5d2645b094f192a/users/5b21756c60824b0b8bfb173740936f15/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:19.870879 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.881178 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775831-85e1-4ba6-90bd-5c3c6a2f59f1 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.940522 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef163191-cbbf-4186-8346-982d76734848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.941367 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef163191-cbbf-4186-8346-982d76734848 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.941646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef163191-cbbf-4186-8346-982d76734848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.941934 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef163191-cbbf-4186-8346-982d76734848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.942536 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef163191-cbbf-4186-8346-982d76734848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.944190 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef163191-cbbf-4186-8346-982d76734848 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.959869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1398/2789] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:19.964548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:19.975643 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee29ba3-67ce-4fa5-a2a0-62803051c0e1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:19.981276 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:19.982032 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:19.982306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:19.982572 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] PATH_INFO: `/v3/projects/306b17ff3ec34d96b5d2645b094f192a/users/5b21756c60824b0b8bfb173740936f15/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:19.984548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=306b17ff3ec34d96b5d2645b094f192a, user_id=5b21756c60824b0b8bfb173740936f15, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:19.987249 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:19.997837 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1392/2790] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:19 2022] PUT /identity/v3/projects/306b17ff3ec34d96b5d2645b094f192a/users/5b21756c60824b0b8bfb173740936f15/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:20.008661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:20.008941 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:20.009210 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:20.040650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] MFA Rules not processed for user `5b21756c60824b0b8bfb173740936f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:20.041874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:20.059972 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:20.110153 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1399/2791] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:20.122813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:20.125861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:20.193230 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6daf70-e24e-4e7a-8fbf-12f34f1dee2d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:20.197603 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:20.198215 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:20.198491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:20.198754 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:20.258645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:20.260161 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:20.269693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1393/2792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:21.659145 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:21.660833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:21.674487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7cc8-f941-411e-868a-dac15e3d7b86 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:21.678639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65465ac0-f406-409d-90c5-b295df1a170e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:21.679278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65465ac0-f406-409d-90c5-b295df1a170e service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:21.679594 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65465ac0-f406-409d-90c5-b295df1a170e service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:21.679922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65465ac0-f406-409d-90c5-b295df1a170e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:21.690052 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65465ac0-f406-409d-90c5-b295df1a170e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:21.692172 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65465ac0-f406-409d-90c5-b295df1a170e service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:21.702405 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1400/2793] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:25.540693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:25.607937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af904e-14f5-49f4-ad0b-1762b3300148 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:25.615487 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:25.616173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:25.616443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:25.616710 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] PATH_INFO: `/v3/users/733dcfaea56c4c3fae32e6a93cb0d6b5` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:25.617905 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=733dcfaea56c4c3fae32e6a93cb0d6b5)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:25.620025 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:25.636115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:25.669813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733dcfaea56c4c3fae32e6a93cb0d6b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:25.678219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733dcfaea56c4c3fae32e6a93cb0d6b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:25.690009 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733dcfaea56c4c3fae32e6a93cb0d6b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:25.691020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733dcfaea56c4c3fae32e6a93cb0d6b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:25.691631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733dcfaea56c4c3fae32e6a93cb0d6b5'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:25.703713 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1394/2794] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:40:25 2022] DELETE /identity/v3/users/733dcfaea56c4c3fae32e6a93cb0d6b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:25.708434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:25.708960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:25.708960 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:25.728608 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:25.729806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:25.794478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1401/2795] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:25.805542 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:25.807212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:25.866844 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30a82-37e5-43f6-9663-5393843ad570 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:25.870904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:25.871516 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:25.871792 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:25.872059 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:25.881920 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:25.884179 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:25.895517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1395/2796] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:26.190039 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:26.191928 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:26.204380 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e5472-ff7a-4e9c-8a71-3b36e9c33476 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:26.210299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:26.210988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:26.211253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:26.211527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] PATH_INFO: `/v3/projects/3287b0dff0674d8f8a72ea4751d8098c` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:26.212742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3287b0dff0674d8f8a72ea4751d8098c)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:26.214754 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:26.261965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3287b0dff0674d8f8a72ea4751d8098c', 'request_id': 'req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.268164 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3287b0dff0674d8f8a72ea4751d8098c', 'request_id': 'req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.276572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3287b0dff0674d8f8a72ea4751d8098c', 'request_id': 'req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.287871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] The token cache is being invalidate because project 3287b0dff0674d8f8a72ea4751d8098c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:40:26.288156 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.288856 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.290474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1402/2797] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:40:26 2022] DELETE /identity/v3/projects/3287b0dff0674d8f8a72ea4751d8098c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:26.294862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:26.304904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9590922-fe45-481a-9c5a-fd9fb572c141 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:26.362645 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:26.363305 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:26.363579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:26.363873 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] PATH_INFO: `/v3/users/5b21756c60824b0b8bfb173740936f15` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:26.365098 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b21756c60824b0b8bfb173740936f15)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:26.367061 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:26.410081 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:26.424880 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b21756c60824b0b8bfb173740936f15'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.434105 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b21756c60824b0b8bfb173740936f15'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.446795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b21756c60824b0b8bfb173740936f15'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.447538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b21756c60824b0b8bfb173740936f15'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.448227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8398b659-7082-4aaa-bedd-cd56d5fb2a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b21756c60824b0b8bfb173740936f15'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.461115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1396/2798] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:40:26 2022] DELETE /identity/v3/users/5b21756c60824b0b8bfb173740936f15 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:26.735395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:26.736939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:26.750481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe7e0e-2726-4b0f-995c-c19e175bb71e admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:26.777407 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:26.810633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:26.811356 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:26.811540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:26.811833 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] PATH_INFO: `/v3/projects/306b17ff3ec34d96b5d2645b094f192a` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:26.812973 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306b17ff3ec34d96b5d2645b094f192a)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:26.814922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:26.863747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306b17ff3ec34d96b5d2645b094f192a', 'request_id': 'req-3e500837-dbdd-475c-83db-cafc0d95df74'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.869142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306b17ff3ec34d96b5d2645b094f192a', 'request_id': 'req-3e500837-dbdd-475c-83db-cafc0d95df74'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.877738 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306b17ff3ec34d96b5d2645b094f192a', 'request_id': 'req-3e500837-dbdd-475c-83db-cafc0d95df74'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.888866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] The token cache is being invalidate because project 306b17ff3ec34d96b5d2645b094f192a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:40:26.889150 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.889855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-3e500837-dbdd-475c-83db-cafc0d95df74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:26.891426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1403/2799] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:40:26 2022] DELETE /identity/v3/projects/306b17ff3ec34d96b5d2645b094f192a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:26.896389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0496f-0312-4f29-897f-ef0235c702f9 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:26.896889 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0496f-0312-4f29-897f-ef0235c702f9 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:26.896986 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0496f-0312-4f29-897f-ef0235c702f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:26.916495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2fc0496f-0312-4f29-897f-ef0235c702f9 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:26.917706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2fc0496f-0312-4f29-897f-ef0235c702f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:26.980062 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1397/2800] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:26.988859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8929c-6c40-4ad6-b748-0987d0c397a8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:26.989197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8929c-6c40-4ad6-b748-0987d0c397a8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:26.989528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8929c-6c40-4ad6-b748-0987d0c397a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.012237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-14f8929c-6c40-4ad6-b748-0987d0c397a8 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:27.013442 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-14f8929c-6c40-4ad6-b748-0987d0c397a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:27.023025 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1404/2801] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:27.027477 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0496f-0312-4f29-897f-ef0235c702f9 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.037693 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0496f-0312-4f29-897f-ef0235c702f9 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.043227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.043858 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.044135 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.044406 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.045050 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:40:27.045356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.046984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.058739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1398/2802] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:40:27.063251 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8929c-6c40-4ad6-b748-0987d0c397a8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.073045 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8929c-6c40-4ad6-b748-0987d0c397a8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.078488 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.079109 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.079383 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.079639 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.080253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.082147 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.111891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1405/2803] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:27 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:27.116164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.126736 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42432a-70c7-4181-b395-f0c3bb29eea1 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.187285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.187896 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.188169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.188442 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.189065 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.191387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.215164 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1399/2804] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:27 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:27.221032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.232252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b4c94-3a9c-44f6-b813-8df2a370b8c3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.237997 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.238606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.239096 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.239365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.239985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.241606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.251598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1406/2805] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:27.255514 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.265606 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414e66d-f428-4258-a176-496ded3ef419 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.271573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dfd9b-317b-462b-97f1-ed6dd86524f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.272167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dfd9b-317b-462b-97f1-ed6dd86524f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.272435 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dfd9b-317b-462b-97f1-ed6dd86524f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.272696 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dfd9b-317b-462b-97f1-ed6dd86524f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.273329 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dfd9b-317b-462b-97f1-ed6dd86524f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.274981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dfd9b-317b-462b-97f1-ed6dd86524f3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.285937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1400/2806] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:27.290241 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.300511 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a06d4c-f986-4b6d-b8db-7f5d363d349c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.305651 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.306291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.306577 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.306858 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] PATH_INFO: `/v3/projects/886ff67ea11a459ca7f2cf948d53a8c7/users/35c390df95eb482b856f958cdba58c8d/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.321988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886ff67ea11a459ca7f2cf948d53a8c7, user_id=35c390df95eb482b856f958cdba58c8d, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.324716 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.339666 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1407/2807] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:27 2022] PUT /identity/v3/projects/886ff67ea11a459ca7f2cf948d53a8c7/users/35c390df95eb482b856f958cdba58c8d/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:27.350205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36b07b-390d-4600-b903-d27a6d1e1e40 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.350459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36b07b-390d-4600-b903-d27a6d1e1e40 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.350742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36b07b-390d-4600-b903-d27a6d1e1e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.378988 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-7d36b07b-390d-4600-b903-d27a6d1e1e40 None None] MFA Rules not processed for user `35c390df95eb482b856f958cdba58c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:27.380217 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-7d36b07b-390d-4600-b903-d27a6d1e1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:27.388753 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:27.456610 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1401/2808] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:27.461372 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.523249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:27.535479 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c868c7-518b-47ff-add0-556c1c11f651 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.542074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.542687 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.542999 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.543273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.543906 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.545866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.574961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1408/2809] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:27 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:27.579351 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36b07b-390d-4600-b903-d27a6d1e1e40 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.590362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36b07b-390d-4600-b903-d27a6d1e1e40 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.651705 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.652383 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.652655 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.652925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.653563 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.655539 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.681600 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1402/2810] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:27 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:27.682855 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.693686 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e29d-5835-49e3-b2c1-96c0432a137a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.698429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.699097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.699376 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.699676 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.700325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.701921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.712232 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1409/2811] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:27.716338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.726662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e67d90-b38e-45bf-9968-bcda7f1af97f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.731822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.732469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.732739 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.732989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] PATH_INFO: `/v3/projects/c4c5955b8b3b45a783acf9e210b67309/users/074b30162ae24915b6248c1e86734d70/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.748257 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c5955b8b3b45a783acf9e210b67309, user_id=074b30162ae24915b6248c1e86734d70, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.750962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.764839 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1403/2812] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:27 2022] PUT /identity/v3/projects/c4c5955b8b3b45a783acf9e210b67309/users/074b30162ae24915b6248c1e86734d70/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:27.768916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.779718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec48cf5-8ce0-448b-8400-dad26d26496a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.864243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77cf16-4df2-4968-9004-72aaf5fc2ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.864760 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77cf16-4df2-4968-9004-72aaf5fc2ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.865037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77cf16-4df2-4968-9004-72aaf5fc2ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.865302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77cf16-4df2-4968-9004-72aaf5fc2ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.865922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77cf16-4df2-4968-9004-72aaf5fc2ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.867592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77cf16-4df2-4968-9004-72aaf5fc2ad3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.882255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1410/2813] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:40:27.888524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:27.899631 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a3bf1-0ebd-418e-b52a-439e8b9fefa8 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:27.905474 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:27.906129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.906405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.906676 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] PATH_INFO: `/v3/projects/c4c5955b8b3b45a783acf9e210b67309/users/074b30162ae24915b6248c1e86734d70/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.908773 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c5955b8b3b45a783acf9e210b67309, user_id=074b30162ae24915b6248c1e86734d70, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:27.911459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:27.922922 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1404/2814] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:27 2022] PUT /identity/v3/projects/c4c5955b8b3b45a783acf9e210b67309/users/074b30162ae24915b6248c1e86734d70/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:27.934314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a01724-8102-4ce4-84e2-0c92f6313eb5 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:27.934621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a01724-8102-4ce4-84e2-0c92f6313eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:27.934921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a01724-8102-4ce4-84e2-0c92f6313eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:27.964224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f8a01724-8102-4ce4-84e2-0c92f6313eb5 None None] MFA Rules not processed for user `074b30162ae24915b6248c1e86734d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:27.965448 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f8a01724-8102-4ce4-84e2-0c92f6313eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:28.035927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1411/2815] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:28.047206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:28.049163 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:28.110507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e2fb-6028-441d-8c27-088ee1c087b5 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:28.115036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:28.115575 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:28.115838 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:28.116125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:28.127100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:28.128561 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:28.138973 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1405/2816] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:28.244929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a01724-8102-4ce4-84e2-0c92f6313eb5 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:28.254926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a01724-8102-4ce4-84e2-0c92f6313eb5 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:28.258712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2394fc-1d46-4e71-be68-38aa2480c828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:28.259334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2394fc-1d46-4e71-be68-38aa2480c828 service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:28.259604 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2394fc-1d46-4e71-be68-38aa2480c828 service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:28.259873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2394fc-1d46-4e71-be68-38aa2480c828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:28.303609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:28.315518 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2394fc-1d46-4e71-be68-38aa2480c828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:28.317316 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2394fc-1d46-4e71-be68-38aa2480c828 service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:28.326240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1412/2817] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:30.957100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:30.963165 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:31.024020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85441f0-caf3-4dee-b669-9efa6ce2684a service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:31.029467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:31.030090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:31.030367 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:31.030650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] PATH_INFO: `/v3/users/35c390df95eb482b856f958cdba58c8d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:31.031817 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c390df95eb482b856f958cdba58c8d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:31.033727 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:31.085933 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c390df95eb482b856f958cdba58c8d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.094146 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c390df95eb482b856f958cdba58c8d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.105898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c390df95eb482b856f958cdba58c8d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.106605 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c390df95eb482b856f958cdba58c8d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.107324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c390df95eb482b856f958cdba58c8d'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.119929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1406/2818] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:40:30 2022] DELETE /identity/v3/users/35c390df95eb482b856f958cdba58c8d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:31.124873 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:31.125369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:31.125478 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:31.144763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:31.146027 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:31.207227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1413/2819] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:40:31.217591 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:31.219155 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:31.281150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971247c7-3e62-4708-a8d5-78a92a4e70dc admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:31.285337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:31.285975 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:31.286253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:31.286527 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:31.296004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:31.297444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:31.306847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1407/2820] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:31.574161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:31.575781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:31.595702 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aef25-d20c-41f0-9cc3-5679dfff8e46 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:31.602123 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:31.602765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:31.603083 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:31.603348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] PATH_INFO: `/v3/projects/886ff67ea11a459ca7f2cf948d53a8c7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:31.604556 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=886ff67ea11a459ca7f2cf948d53a8c7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:31.606510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:31.672672 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886ff67ea11a459ca7f2cf948d53a8c7', 'request_id': 'req-f9fb492e-7328-4293-b893-82dcda7cf0de'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.678776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886ff67ea11a459ca7f2cf948d53a8c7', 'request_id': 'req-f9fb492e-7328-4293-b893-82dcda7cf0de'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.687151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886ff67ea11a459ca7f2cf948d53a8c7', 'request_id': 'req-f9fb492e-7328-4293-b893-82dcda7cf0de'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.698462 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] The token cache is being invalidate because project 886ff67ea11a459ca7f2cf948d53a8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:40:31.698741 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.699410 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.700931 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1414/2821] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:40:31 2022] DELETE /identity/v3/projects/886ff67ea11a459ca7f2cf948d53a8c7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:31.705398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:31.715337 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e5cd0-613b-44ba-9e3f-075f55c561f3 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:31.739398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:31.773393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:31.773937 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:31.774213 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:31.774485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] PATH_INFO: `/v3/users/074b30162ae24915b6248c1e86734d70` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:31.775670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074b30162ae24915b6248c1e86734d70)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:31.777592 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:31.825200 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074b30162ae24915b6248c1e86734d70'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.833248 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074b30162ae24915b6248c1e86734d70'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.844938 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074b30162ae24915b6248c1e86734d70'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.845571 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074b30162ae24915b6248c1e86734d70'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.846166 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-417aea4e-1436-4d9a-8c93-e350f42640e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074b30162ae24915b6248c1e86734d70'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:31.858168 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1408/2822] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:40:31 2022] DELETE /identity/v3/users/074b30162ae24915b6248c1e86734d70 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:32.133058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.134543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:32.147841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb492e-7328-4293-b893-82dcda7cf0de admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.204062 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.204699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.204975 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.205244 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] PATH_INFO: `/v3/projects/c4c5955b8b3b45a783acf9e210b67309` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.206411 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c5955b8b3b45a783acf9e210b67309)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.208348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.219417 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:32.256148 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c5955b8b3b45a783acf9e210b67309', 'request_id': 'req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:32.262098 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c5955b8b3b45a783acf9e210b67309', 'request_id': 'req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:32.272286 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c5955b8b3b45a783acf9e210b67309', 'request_id': 'req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:32.283043 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] The token cache is being invalidate because project c4c5955b8b3b45a783acf9e210b67309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:40:32.283323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:32.283929 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-9c02e869-ac5f-4815-b4c2-16b2de6a9ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:32.285429 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1415/2823] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:40:32 2022] DELETE /identity/v3/projects/c4c5955b8b3b45a783acf9e210b67309 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:32.290446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237df52-fd4c-4d72-9191-c2f950303355 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.290974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237df52-fd4c-4d72-9191-c2f950303355 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.291079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237df52-fd4c-4d72-9191-c2f950303355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.312103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2237df52-fd4c-4d72-9191-c2f950303355 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:32.313232 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2237df52-fd4c-4d72-9191-c2f950303355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:32.371664 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1409/2824] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:32.379841 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b0bef-1c7b-472a-9d73-7ffa772ca02f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.380122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b0bef-1c7b-472a-9d73-7ffa772ca02f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.380390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b0bef-1c7b-472a-9d73-7ffa772ca02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.401296 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-f39b0bef-1c7b-472a-9d73-7ffa772ca02f None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:32.402485 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-f39b0bef-1c7b-472a-9d73-7ffa772ca02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:32.411995 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1416/2825] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:32.416752 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237df52-fd4c-4d72-9191-c2f950303355 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.426712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237df52-fd4c-4d72-9191-c2f950303355 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.432312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.432910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.433181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.433446 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.434087 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:40:32.434404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.436060 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.448103 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1410/2826] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:40:32.452573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b0bef-1c7b-472a-9d73-7ffa772ca02f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.462076 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b0bef-1c7b-472a-9d73-7ffa772ca02f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.467234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.467847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.468097 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.468362 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.468984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.470950 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.500629 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1417/2827] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:32 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:32.504939 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.515271 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228364-1bbf-495c-a07f-9bf5fa6efaf6 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.544478 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:32.572794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.573327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.573602 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.573870 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.574500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.576491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.602084 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1411/2828] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:32 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:32.608466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.622297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e077-df3e-4ced-86e3-9eac45559f19 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.628165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.628788 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.629106 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.629359 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.630003 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.631685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.642632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1418/2829] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:40:32.646926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.657089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c5dc-ad61-415f-a016-d6a482a52863 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.662212 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21b119-281a-4306-a43e-c2aa58fa595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.662801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b119-281a-4306-a43e-c2aa58fa595b admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.663107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b119-281a-4306-a43e-c2aa58fa595b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.663369 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b119-281a-4306-a43e-c2aa58fa595b admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.664008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21b119-281a-4306-a43e-c2aa58fa595b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.665593 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21b119-281a-4306-a43e-c2aa58fa595b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.677498 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1412/2830] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:32.681650 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.692040 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3855af-a488-4c3b-be25-317181f53aa7 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.696910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.697551 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.697825 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.698092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] PATH_INFO: `/v3/projects/f5e5440313294f148c088c351868d738/users/e708b41ddc5f4b3fab10e03d708af639/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.712430 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e5440313294f148c088c351868d738, user_id=e708b41ddc5f4b3fab10e03d708af639, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.715116 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.730503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1419/2831] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:32 2022] PUT /identity/v3/projects/f5e5440313294f148c088c351868d738/users/e708b41ddc5f4b3fab10e03d708af639/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:32.741204 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567736-2f82-4539-981a-9a0c81332606 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.741484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567736-2f82-4539-981a-9a0c81332606 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.741751 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567736-2f82-4539-981a-9a0c81332606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.768904 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-ec567736-2f82-4539-981a-9a0c81332606 None None] MFA Rules not processed for user `e708b41ddc5f4b3fab10e03d708af639`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:32.770100 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ec567736-2f82-4539-981a-9a0c81332606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:32.839099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1413/2832] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:40:32.843932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.915984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec746a6c-caa8-4892-9456-253d9b057e49 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:32.921669 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:32.922248 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:32.922535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:32.922842 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:32.923464 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:32.925371 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:32.954481 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1420/2833] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:32 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:32.958706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567736-2f82-4539-981a-9a0c81332606 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:32.969569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567736-2f82-4539-981a-9a0c81332606 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:33.027336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:33.027964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:33.028231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:33.028500 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:33.029140 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:33.031157 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:33.055243 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1414/2834] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:32 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:33.059370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:33.070294 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb4ef0-7050-4e9a-9d6f-74a086de538c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:33.076026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:33.076624 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:33.076898 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:33.077161 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:33.077912 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:33.079597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:33.090041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1421/2835] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:33.093972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:33.103795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855c54-bd5a-4f3f-8fa7-818897e61c55 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:33.109117 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:33.109765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:33.110037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:33.110300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] PATH_INFO: `/v3/projects/19a6e6486b4f46a0933d7dba85b94ffa/users/a1fade1e87fc476fb3f451a928886644/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:33.128020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a6e6486b4f46a0933d7dba85b94ffa, user_id=a1fade1e87fc476fb3f451a928886644, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:33.132265 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:33.149912 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1415/2836] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:33 2022] PUT /identity/v3/projects/19a6e6486b4f46a0933d7dba85b94ffa/users/a1fade1e87fc476fb3f451a928886644/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:40:33.153893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:33.165213 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c93e-2afd-49cb-85f5-9fb3db283294 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:33.175231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:33.227254 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eb5d7-c909-4db2-9bc3-9c1395abb6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:33.227862 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eb5d7-c909-4db2-9bc3-9c1395abb6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:33.228136 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eb5d7-c909-4db2-9bc3-9c1395abb6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:33.228400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eb5d7-c909-4db2-9bc3-9c1395abb6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:33.229037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eb5d7-c909-4db2-9bc3-9c1395abb6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:33.231273 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eb5d7-c909-4db2-9bc3-9c1395abb6ae admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:33.241142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1422/2837] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:33.245558 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:33.257741 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f99b0-ad6d-4a30-aa87-0b1d7f324ec9 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:33.263047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:33.263718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:33.263990 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:33.264251 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] PATH_INFO: `/v3/projects/19a6e6486b4f46a0933d7dba85b94ffa/users/a1fade1e87fc476fb3f451a928886644/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:33.266412 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a6e6486b4f46a0933d7dba85b94ffa, user_id=a1fade1e87fc476fb3f451a928886644, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:33.269090 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:33.271344 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:33.283250 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1416/2838] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:33 2022] PUT /identity/v3/projects/19a6e6486b4f46a0933d7dba85b94ffa/users/a1fade1e87fc476fb3f451a928886644/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:33.352297 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9cd98-fe0c-45b6-b791-50b02266a257 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:33.352563 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9cd98-fe0c-45b6-b791-50b02266a257 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:33.352874 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9cd98-fe0c-45b6-b791-50b02266a257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:33.383237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-04a9cd98-fe0c-45b6-b791-50b02266a257 None None] MFA Rules not processed for user `a1fade1e87fc476fb3f451a928886644`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:33.384471 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-04a9cd98-fe0c-45b6-b791-50b02266a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:33.452886 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1423/2839] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:33.463805 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:33.465740 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:33.528233 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba79c1a-6e80-4d9a-ad87-6eaaba5242ec admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:33.532902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847e1a8-ca57-4a9c-8839-f29a786934a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:33.533569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847e1a8-ca57-4a9c-8839-f29a786934a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:33.533967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847e1a8-ca57-4a9c-8839-f29a786934a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:33.534209 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847e1a8-ca57-4a9c-8839-f29a786934a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:33.543511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847e1a8-ca57-4a9c-8839-f29a786934a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:33.544940 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847e1a8-ca57-4a9c-8839-f29a786934a7 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:33.554418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1417/2840] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:33.942149 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9cd98-fe0c-45b6-b791-50b02266a257 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:34.022757 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9cd98-fe0c-45b6-b791-50b02266a257 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:34.028421 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:34.029048 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:34.029318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:34.029588 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] PATH_INFO: `/v3/users/e708b41ddc5f4b3fab10e03d708af639` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:34.030988 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e708b41ddc5f4b3fab10e03d708af639)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:34.032927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:34.074374 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:34.084939 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e708b41ddc5f4b3fab10e03d708af639'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.092837 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e708b41ddc5f4b3fab10e03d708af639'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.093661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e708b41ddc5f4b3fab10e03d708af639'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.094277 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e708b41ddc5f4b3fab10e03d708af639'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.101323 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e708b41ddc5f4b3fab10e03d708af639'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.120865 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1424/2841] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:40:33 2022] DELETE /identity/v3/users/e708b41ddc5f4b3fab10e03d708af639 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:34.125670 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:34.125962 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:34.126239 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:34.146554 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:34.147823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:34.207125 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1418/2842] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:34.217112 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:34.218891 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:34.278381 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1981576-25a4-4396-837f-ed331b18981f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:34.283061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:34.283677 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:34.283952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:34.284224 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:34.294110 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:34.295598 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:34.305283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1425/2843] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:34.599331 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:34.600974 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:34.613721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696de73-3623-4bf4-8220-b99098dcb410 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:34.620423 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:34.621111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:34.621363 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:34.621662 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] PATH_INFO: `/v3/projects/f5e5440313294f148c088c351868d738` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:34.622984 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e5440313294f148c088c351868d738)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:34.625055 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:34.676195 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e5440313294f148c088c351868d738', 'request_id': 'req-647375bb-3561-4e93-ad54-5d611d96cd9c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.684444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e5440313294f148c088c351868d738', 'request_id': 'req-647375bb-3561-4e93-ad54-5d611d96cd9c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.691725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e5440313294f148c088c351868d738', 'request_id': 'req-647375bb-3561-4e93-ad54-5d611d96cd9c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.703660 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] The token cache is being invalidate because project f5e5440313294f148c088c351868d738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:40:34.704040 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.704698 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.706362 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1419/2844] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:40:34 2022] DELETE /identity/v3/projects/f5e5440313294f148c088c351868d738 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:34.711494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:34.721385 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37481e93-1340-485e-b11a-bf2e76fc07f1 service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:34.780443 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:34.781126 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:34.781426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:34.781674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] PATH_INFO: `/v3/users/a1fade1e87fc476fb3f451a928886644` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:34.782839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fade1e87fc476fb3f451a928886644)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:34.784781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:34.842299 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fade1e87fc476fb3f451a928886644'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.850339 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fade1e87fc476fb3f451a928886644'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.851165 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fade1e87fc476fb3f451a928886644'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.851765 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fade1e87fc476fb3f451a928886644'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.853763 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:34.860032 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a5094e20-e442-42e8-964c-f3c664ac829c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fade1e87fc476fb3f451a928886644'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:34.878185 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1426/2845] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:40:34 2022] DELETE /identity/v3/users/a1fade1e87fc476fb3f451a928886644 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:40:35.164069 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.165569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:35.182190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647375bb-3561-4e93-ad54-5d611d96cd9c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.203470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:35.246364 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.246963 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.247242 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.247513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] PATH_INFO: `/v3/projects/19a6e6486b4f46a0933d7dba85b94ffa` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.248659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a6e6486b4f46a0933d7dba85b94ffa)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.250597 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.298104 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a6e6486b4f46a0933d7dba85b94ffa', 'request_id': 'req-dd98990f-d150-44ef-a6f9-70e2448b55df'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:35.308899 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a6e6486b4f46a0933d7dba85b94ffa', 'request_id': 'req-dd98990f-d150-44ef-a6f9-70e2448b55df'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:35.317373 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a6e6486b4f46a0933d7dba85b94ffa', 'request_id': 'req-dd98990f-d150-44ef-a6f9-70e2448b55df'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:35.332721 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] The token cache is being invalidate because project 19a6e6486b4f46a0933d7dba85b94ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:40:35.333148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:35.333862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-dd98990f-d150-44ef-a6f9-70e2448b55df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:40:35.335466 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1420/2846] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:40:35 2022] DELETE /identity/v3/projects/19a6e6486b4f46a0933d7dba85b94ffa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:35.340568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7e0af-a952-4137-9bfe-022ae913522e None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.341036 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7e0af-a952-4137-9bfe-022ae913522e None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.341152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7e0af-a952-4137-9bfe-022ae913522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.362180 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-7ad7e0af-a952-4137-9bfe-022ae913522e None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:35.363954 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-7ad7e0af-a952-4137-9bfe-022ae913522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:35.425029 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1427/2847] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:40:35.433214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc0979-94b1-4d8a-ad9f-03c467b8cb65 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.433511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc0979-94b1-4d8a-ad9f-03c467b8cb65 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.433791 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc0979-94b1-4d8a-ad9f-03c467b8cb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.455287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-77bc0979-94b1-4d8a-ad9f-03c467b8cb65 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:35.456522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-77bc0979-94b1-4d8a-ad9f-03c467b8cb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:35.465556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1421/2848] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:35.470020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7e0af-a952-4137-9bfe-022ae913522e None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.480176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7e0af-a952-4137-9bfe-022ae913522e None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.485658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.486278 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.486543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.486815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.487504 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:40:35.487800 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.489416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.501682 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1428/2849] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:40:35.506240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc0979-94b1-4d8a-ad9f-03c467b8cb65 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.516021 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc0979-94b1-4d8a-ad9f-03c467b8cb65 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.521955 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.522570 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.522840 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.523119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.523748 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.525802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.557601 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1422/2850] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:35 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:35.562507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.573684 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aeaa0-b7bd-47e1-9969-5cb856aa107a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.636703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.637334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.637585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.637859 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.638538 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.640541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.664426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1429/2851] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:35 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:35.668804 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.679534 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce41f-841c-4231-95d0-1cc34dcce991 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.685294 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.685902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.686175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.686445 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.687211 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.688842 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.700099 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1423/2852] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:35.704307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.714724 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ed43e-14cf-466e-95ef-e06d56b48bd8 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.720208 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8335123-ce3d-43b1-8db5-8771aab13640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.720812 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335123-ce3d-43b1-8db5-8771aab13640 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.721095 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335123-ce3d-43b1-8db5-8771aab13640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.721366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335123-ce3d-43b1-8db5-8771aab13640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.722009 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8335123-ce3d-43b1-8db5-8771aab13640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.723632 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8335123-ce3d-43b1-8db5-8771aab13640 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.734470 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1430/2853] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:35.738719 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.748978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9b35-5f74-40a0-996a-6b40b5cdaafa admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.754284 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.754856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.755132 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.755395 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] PATH_INFO: `/v3/projects/832cd7ebeceb45148b6bc2572dfae928/users/0e28c72579754503a5dbf45fb8c958b6/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.770522 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832cd7ebeceb45148b6bc2572dfae928, user_id=0e28c72579754503a5dbf45fb8c958b6, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.773188 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.787283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1424/2854] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:35 2022] PUT /identity/v3/projects/832cd7ebeceb45148b6bc2572dfae928/users/0e28c72579754503a5dbf45fb8c958b6/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:35.792565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8682c1-a396-41e8-809e-f7028e09170b None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.792849 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8682c1-a396-41e8-809e-f7028e09170b None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.793120 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8682c1-a396-41e8-809e-f7028e09170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.812433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-8f8682c1-a396-41e8-809e-f7028e09170b None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:35.813636 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-8f8682c1-a396-41e8-809e-f7028e09170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:35.847088 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:35.872689 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1431/2855] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:35.882536 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:35.884356 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:35.943013 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:35.947712 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ed26b-a22b-465c-b92b-8439b516bdc7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:35.954156 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:35.954807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:35.955116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:35.955392 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:35.965802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:35.967286 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:35.976802 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1425/2856] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:36.620455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e7e8-a779-4628-aa15-b7a7e47a7eda None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:36.621014 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e7e8-a779-4628-aa15-b7a7e47a7eda None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:36.621428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e7e8-a779-4628-aa15-b7a7e47a7eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:36.662363 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a141e7e8-a779-4628-aa15-b7a7e47a7eda None None] MFA Rules not processed for user `0e28c72579754503a5dbf45fb8c958b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:36.663904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a141e7e8-a779-4628-aa15-b7a7e47a7eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:36.732314 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1432/2857] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:40:36.737382 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:36.748095 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565ebc4-c104-48ee-8e87-a4ce4674b1d0 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:36.753112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:36.753826 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:36.754162 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:36.754496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:36.755234 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:36.757193 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:36.786399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1426/2858] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:40:36 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:36.790683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e7e8-a779-4628-aa15-b7a7e47a7eda None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:36.802090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e7e8-a779-4628-aa15-b7a7e47a7eda None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:36.861198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:36.861815 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:36.862089 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:36.862329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:36.863007 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:36.864948 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:36.887990 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1433/2859] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:40:36 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:40:36.892287 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:36.903481 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b33b8-8dd3-45fb-9b01-237d5a5ab974 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:36.909227 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:36.909836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:36.910114 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:36.910417 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:36.911111 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:36.912692 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:36.923936 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1427/2860] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:36.928265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:36.942434 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858fdc-4f49-419c-b07c-d626ebefc50f admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:36.949897 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:36.950885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:36.951162 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:36.951480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] PATH_INFO: `/v3/projects/e39155851e1643448938b57b29016110/users/6417faaa5b704686a63e5b8a2df8acd9/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:36.967984 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39155851e1643448938b57b29016110, user_id=6417faaa5b704686a63e5b8a2df8acd9, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:36.970698 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:36.985703 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1434/2861] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:36 2022] PUT /identity/v3/projects/e39155851e1643448938b57b29016110/users/6417faaa5b704686a63e5b8a2df8acd9/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:36.989861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:37.000014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3e21-46c2-4a88-8f56-ea3216168e8d admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:37.057765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08567c4d-fadb-4b5d-9720-f0c96acb51bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:37.058300 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567c4d-fadb-4b5d-9720-f0c96acb51bc admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:37.058577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567c4d-fadb-4b5d-9720-f0c96acb51bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:37.058862 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08567c4d-fadb-4b5d-9720-f0c96acb51bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:37.059511 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08567c4d-fadb-4b5d-9720-f0c96acb51bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:37.061106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08567c4d-fadb-4b5d-9720-f0c96acb51bc admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:37.071167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1428/2862] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:40:37.075575 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:37.086197 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843b41-2e17-4798-8089-906b4d07ec50 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:37.091199 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a8839-2f0a-4c89-95d7-404762abd5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:37.091847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a8839-2f0a-4c89-95d7-404762abd5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:37.092122 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a8839-2f0a-4c89-95d7-404762abd5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:37.092428 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a8839-2f0a-4c89-95d7-404762abd5dd admin admin] PATH_INFO: `/v3/projects/e39155851e1643448938b57b29016110/users/6417faaa5b704686a63e5b8a2df8acd9/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:37.094416 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a8839-2f0a-4c89-95d7-404762abd5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39155851e1643448938b57b29016110, user_id=6417faaa5b704686a63e5b8a2df8acd9, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:37.097201 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a8839-2f0a-4c89-95d7-404762abd5dd admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:37.107818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1435/2863] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:40:37 2022] PUT /identity/v3/projects/e39155851e1643448938b57b29016110/users/6417faaa5b704686a63e5b8a2df8acd9/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:40:37.749770 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:37.750285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:37.750408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:37.781911 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] MFA Rules not processed for user `6417faaa5b704686a63e5b8a2df8acd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:37.783206 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:37.858918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1429/2864] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:40:37.869574 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:37.870137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:37.870137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:37.889926 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] MFA Rules not processed for user `0e28c72579754503a5dbf45fb8c958b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:40:37.891094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:37.908633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:37.949298 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1436/2865] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:40:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:40:37.962594 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:37.964269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:38.009301 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:38.044418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a958-d7e2-44d7-a65c-3a52ea37eb26 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:38.051315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:38.051929 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:38.052201 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:38.052467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:38.060847 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:38.062449 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:38.071672 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1430/2866] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:38.105591 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:38.107276 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:38.168228 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be37b9a-cb1b-4d97-af4d-ad7eea9612ec None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:38.172517 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870f9d558024213a6db2c32a8d6de24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:38.173130 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:38.173399 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:38.173663 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:38.175851 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:38.189869 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:38.191685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:38.202776 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1437/2867] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:38.770981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:38.828043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332f6fd-5fbb-4f67-a930-f1ed9e9791bf service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:38.831853 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:38.832470 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:38.832772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:38.833043 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:38.834846 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:38.853467 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:38.855133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:38.866636 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1431/2868] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:40:48.197922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=41 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:48.862327 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=43 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:51.299592 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:40:51.301252 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:40:51.360868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae939-5e42-4285-bfcf-9da500ac36fc service glance] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:40:51.365222 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:40:51.365838 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:40:51.366118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:40:51.366390 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:40:51.375451 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:40:51.376895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:40:51.386249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1438/2869] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:40:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:01.382047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=26 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:11.357931 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:11.419700 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff92f6f-578b-4e24-a0d7-418746e0c3b2 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:11.425183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:11.425822 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:11.426086 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:11.426350 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] PATH_INFO: `/v3/users/0e28c72579754503a5dbf45fb8c958b6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:11.427725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e28c72579754503a5dbf45fb8c958b6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:11.429684 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:11.478635 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e28c72579754503a5dbf45fb8c958b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.487203 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e28c72579754503a5dbf45fb8c958b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.499433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e28c72579754503a5dbf45fb8c958b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.500081 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e28c72579754503a5dbf45fb8c958b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.500680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e28c72579754503a5dbf45fb8c958b6'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.513893 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1432/2870] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:41:11 2022] DELETE /identity/v3/users/0e28c72579754503a5dbf45fb8c958b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:11.696202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:11.708880 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbff2d-4cef-49a5-b0ec-16cf9ee406ad service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:11.767907 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:11.768548 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:11.768820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:11.769090 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] PATH_INFO: `/v3/projects/832cd7ebeceb45148b6bc2572dfae928` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:11.770250 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832cd7ebeceb45148b6bc2572dfae928)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:11.772234 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:11.821191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832cd7ebeceb45148b6bc2572dfae928', 'request_id': 'req-fed03564-c5d6-4c78-ad07-87686b4177e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.826809 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832cd7ebeceb45148b6bc2572dfae928', 'request_id': 'req-fed03564-c5d6-4c78-ad07-87686b4177e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.836447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832cd7ebeceb45148b6bc2572dfae928', 'request_id': 'req-fed03564-c5d6-4c78-ad07-87686b4177e6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.849204 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] The token cache is being invalidate because project 832cd7ebeceb45148b6bc2572dfae928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:41:11.849495 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.850350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.851961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1439/2871] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:41:11 2022] DELETE /identity/v3/projects/832cd7ebeceb45148b6bc2572dfae928 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:11.856170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:11.857604 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:11.871205 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b338a-31f0-4367-a2bf-6fdc077ac39b admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:11.933408 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:11.934041 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:11.934315 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:11.934704 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] PATH_INFO: `/v3/users/6417faaa5b704686a63e5b8a2df8acd9` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:11.935898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6417faaa5b704686a63e5b8a2df8acd9)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:11.937813 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:11.959459 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:11.988433 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6417faaa5b704686a63e5b8a2df8acd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:11.996357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6417faaa5b704686a63e5b8a2df8acd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.008841 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6417faaa5b704686a63e5b8a2df8acd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.009460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6417faaa5b704686a63e5b8a2df8acd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.010112 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-2cdb81be-c05c-41e0-8c5f-cf8737697e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6417faaa5b704686a63e5b8a2df8acd9'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.022898 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1433/2872] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:41:11 2022] DELETE /identity/v3/users/6417faaa5b704686a63e5b8a2df8acd9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:41:12.198142 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:12.199803 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:12.212332 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03564-c5d6-4c78-ad07-87686b4177e6 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:12.269662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:12.270302 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.270565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.270866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] PATH_INFO: `/v3/projects/e39155851e1643448938b57b29016110` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.272016 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39155851e1643448938b57b29016110)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:12.273945 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:12.309237 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:12.323144 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39155851e1643448938b57b29016110', 'request_id': 'req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.328583 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39155851e1643448938b57b29016110', 'request_id': 'req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.336966 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39155851e1643448938b57b29016110', 'request_id': 'req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.348151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] The token cache is being invalidate because project e39155851e1643448938b57b29016110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:41:12.348433 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.349170 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4899676e-35ff-4bf8-9e52-c6ccccb5af9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:12.350742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1440/2873] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:41:12 2022] DELETE /identity/v3/projects/e39155851e1643448938b57b29016110 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:12.355907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a527d-22b1-4061-9fa8-a47a4661366c None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.356223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a527d-22b1-4061-9fa8-a47a4661366c None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.356495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a527d-22b1-4061-9fa8-a47a4661366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.376992 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-d28a527d-22b1-4061-9fa8-a47a4661366c None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:12.378190 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d28a527d-22b1-4061-9fa8-a47a4661366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:12.436852 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1434/2874] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:12.445211 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3776af-90ea-4adc-af33-ce5bfdc84691 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.445487 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3776af-90ea-4adc-af33-ce5bfdc84691 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.445755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3776af-90ea-4adc-af33-ce5bfdc84691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.465494 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-4f3776af-90ea-4adc-af33-ce5bfdc84691 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:12.466688 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4f3776af-90ea-4adc-af33-ce5bfdc84691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:12.475491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1441/2875] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:12.481471 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a527d-22b1-4061-9fa8-a47a4661366c None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:12.492311 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a527d-22b1-4061-9fa8-a47a4661366c None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:12.498133 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:12.498771 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.499085 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.499354 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.500011 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:41:12.500312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:12.501902 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:12.515807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1435/2876] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 07:41:12.520207 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3776af-90ea-4adc-af33-ce5bfdc84691 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:12.529853 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3776af-90ea-4adc-af33-ce5bfdc84691 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:12.535781 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:12.536477 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.536747 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.537008 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.537637 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:12.539603 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:12.572004 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1442/2877] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:41:12 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:12.576357 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:12.586560 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208060-6642-4533-8aab-9278ee8cee82 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:12.658183 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:12.658969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.659335 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.659706 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.660438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:12.662439 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:12.688472 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1436/2878] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:41:12 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:12.693151 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:12.704386 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd1c9a-9e82-4afb-9049-c33bedd96ffb admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:12.713335 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:12.714236 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.714606 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.714983 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.715961 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:12.718466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:12.733921 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1443/2879] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:12.740082 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:12.750651 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320364-309e-432b-9c9c-2a13c19c1072 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:12.756653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ec42a-ad44-408b-9bd7-f796f15be114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:12.757263 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ec42a-ad44-408b-9bd7-f796f15be114 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.757553 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ec42a-ad44-408b-9bd7-f796f15be114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.757801 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ec42a-ad44-408b-9bd7-f796f15be114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.758469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ec42a-ad44-408b-9bd7-f796f15be114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:12.760139 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ec42a-ad44-408b-9bd7-f796f15be114 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:12.771573 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1437/2880] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:12.775814 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:12.786348 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec58532-d7bd-41ea-a34d-a5c2def4d2d0 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:12.791673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:12.792325 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.792584 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.792881 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] PATH_INFO: `/v3/projects/34e1ff4e9d6a46c3ab1b3b23cfdeb57d/users/8904b7a97dc542c19f9ae5ccd5173c52/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.808065 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e1ff4e9d6a46c3ab1b3b23cfdeb57d, user_id=8904b7a97dc542c19f9ae5ccd5173c52, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:12.810779 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:12.826074 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1444/2881] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:41:12 2022] PUT /identity/v3/projects/34e1ff4e9d6a46c3ab1b3b23cfdeb57d/users/8904b7a97dc542c19f9ae5ccd5173c52/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:12.836484 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451d73-9fe6-443f-8d17-8fa16539cc3e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:12.836765 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451d73-9fe6-443f-8d17-8fa16539cc3e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:12.837033 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451d73-9fe6-443f-8d17-8fa16539cc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:12.845944 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:12.869346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-6c451d73-9fe6-443f-8d17-8fa16539cc3e None None] MFA Rules not processed for user `8904b7a97dc542c19f9ae5ccd5173c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:12.870589 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-6c451d73-9fe6-443f-8d17-8fa16539cc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:12.944626 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1438/2882] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:12.949749 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.027137 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905232-1328-491c-b67b-fc6d1425017b admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.032888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.033573 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.033847 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.034111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.034734 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.036806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.067977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1445/2883] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:41:12 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:13.072309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c451d73-9fe6-443f-8d17-8fa16539cc3e None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.083972 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c451d73-9fe6-443f-8d17-8fa16539cc3e None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.144214 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.144823 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.145101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.145346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.146004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.148030 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.173947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1439/2884] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:41:13 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:13.179221 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.189733 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b8bb-a3cc-43dc-80d6-d32b5d4c8933 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.195350 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.195871 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.196146 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.196413 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.197055 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.198656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.209447 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1446/2885] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:13.213324 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.223473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6889c-3503-42a7-b519-f21ecb820161 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.228538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adde62-4f9b-4794-ad95-138c4cae9ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.229148 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adde62-4f9b-4794-ad95-138c4cae9ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.229452 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adde62-4f9b-4794-ad95-138c4cae9ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.229725 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adde62-4f9b-4794-ad95-138c4cae9ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.230371 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adde62-4f9b-4794-ad95-138c4cae9ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.232076 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adde62-4f9b-4794-ad95-138c4cae9ddb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.242495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1440/2886] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:13.246910 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.257467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71503bc-af6e-454d-af6c-a2554fe535ad admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.262761 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.263436 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.263710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.263977 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] PATH_INFO: `/v3/projects/5269f6044c4543ffa6ca23c9e71d54c4/users/4af76c412de74b908d4f744573040f64/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.279520 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5269f6044c4543ffa6ca23c9e71d54c4, user_id=4af76c412de74b908d4f744573040f64, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.282176 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.296902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1447/2887] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:41:13 2022] PUT /identity/v3/projects/5269f6044c4543ffa6ca23c9e71d54c4/users/4af76c412de74b908d4f744573040f64/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:13.310181 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946be6c-4692-49d7-9060-8b66c9bae279 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.310480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946be6c-4692-49d7-9060-8b66c9bae279 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.310879 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946be6c-4692-49d7-9060-8b66c9bae279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.355142 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-9946be6c-4692-49d7-9060-8b66c9bae279 None None] MFA Rules not processed for user `4af76c412de74b908d4f744573040f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:13.356926 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9946be6c-4692-49d7-9060-8b66c9bae279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:13.437910 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1441/2888] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:13.443019 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.453143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:13.506480 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82af7c-e431-4ba6-86ba-47c3207a4e2c admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.511621 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.512223 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.512496 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.512772 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.513408 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.515427 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.543662 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1448/2889] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:41:13 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:13.549360 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946be6c-4692-49d7-9060-8b66c9bae279 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.555418 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:13.563568 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946be6c-4692-49d7-9060-8b66c9bae279 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.626219 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.626859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.627150 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.627450 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] PATH_INFO: `/v3/users` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.628089 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.630048 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.652715 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1442/2890] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:41:13 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:13.659037 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.671322 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743015b2-b28c-4449-a58b-a5130dcc5cad admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.676904 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.677506 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.677778 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.678041 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.678681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.680347 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.692061 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1449/2891] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:13.696517 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.707438 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86ef8-dc5d-4abd-83f0-4a2f4baa423e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.713355 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.714037 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.714307 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.714569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] PATH_INFO: `/v3/projects/334455b4efb14b4399b82214e6ce3be8/users/385ddc60392e4cbf8774b583871b9933/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.732014 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334455b4efb14b4399b82214e6ce3be8, user_id=385ddc60392e4cbf8774b583871b9933, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.734680 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.751458 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1443/2892] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:41:13 2022] PUT /identity/v3/projects/334455b4efb14b4399b82214e6ce3be8/users/385ddc60392e4cbf8774b583871b9933/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:13.755657 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.766285 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b85b-dab2-41f2-9ae1-2f6a98755874 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.824697 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bc244-b728-4446-936f-90d71dce1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.825309 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc244-b728-4446-936f-90d71dce1385 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.825609 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc244-b728-4446-936f-90d71dce1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.825882 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc244-b728-4446-936f-90d71dce1385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.826528 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bc244-b728-4446-936f-90d71dce1385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.828182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bc244-b728-4446-936f-90d71dce1385 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.838135 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1450/2893] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:13.842567 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:13.853453 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419c36-dcdc-487f-bb93-fa9173d6c757 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:13.858548 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:13.859231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.859504 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.859769 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] PATH_INFO: `/v3/projects/334455b4efb14b4399b82214e6ce3be8/users/385ddc60392e4cbf8774b583871b9933/roles/5a0a70f71ec7488a9743c8549e28cbe6` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.861775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334455b4efb14b4399b82214e6ce3be8, user_id=385ddc60392e4cbf8774b583871b9933, role_id=5a0a70f71ec7488a9743c8549e28cbe6)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:13.864419 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:13.875082 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1444/2894] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:41:13 2022] PUT /identity/v3/projects/334455b4efb14b4399b82214e6ce3be8/users/385ddc60392e4cbf8774b583871b9933/roles/5a0a70f71ec7488a9743c8549e28cbe6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:13.886346 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:13.886685 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:13.887066 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:13.918868 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] MFA Rules not processed for user `385ddc60392e4cbf8774b583871b9933`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:13.920111 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:13.995658 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1451/2895] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:14.007310 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:14.010485 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:14.070398 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e303d5-8092-41a0-a0d7-9268da362787 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:14.074381 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:14.075008 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:14.075283 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:14.075551 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:14.133987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:14.135440 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:14.144744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1445/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:15.668086 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:15.669755 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:15.677369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:15.684982 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686c304-a04e-44eb-8e24-1182e16f7529 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:15.688944 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:15.689543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:15.689818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:15.690444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:15.746565 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:15.748318 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:15.757628 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1452/2897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:16.321004 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:16.329950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca82b9-75aa-4184-8f1d-49534a372259 service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:16.334078 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60a32a-4bc9-49fd-b9ba-833ce1a8940e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:16.334686 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a32a-4bc9-49fd-b9ba-833ce1a8940e service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:16.335026 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a32a-4bc9-49fd-b9ba-833ce1a8940e service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:16.335295 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a32a-4bc9-49fd-b9ba-833ce1a8940e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:16.342729 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:16.345240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60a32a-4bc9-49fd-b9ba-833ce1a8940e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:16.346728 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60a32a-4bc9-49fd-b9ba-833ce1a8940e service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:16.358047 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1446/2898] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:20.305467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:20.377492 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8cbc-35b9-47b4-b56f-a622dca3eaba service cinder] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:20.382103 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:20.382718 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:20.383020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:20.383291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] PATH_INFO: `/v3/users/8904b7a97dc542c19f9ae5ccd5173c52` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:20.384466 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8904b7a97dc542c19f9ae5ccd5173c52)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:20.386648 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:20.439313 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8904b7a97dc542c19f9ae5ccd5173c52'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:20.450011 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8904b7a97dc542c19f9ae5ccd5173c52'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:20.450618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8904b7a97dc542c19f9ae5ccd5173c52'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:20.451455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8904b7a97dc542c19f9ae5ccd5173c52'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:20.458516 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8904b7a97dc542c19f9ae5ccd5173c52'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:20.476501 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1453/2899] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:41:20 2022] DELETE /identity/v3/users/8904b7a97dc542c19f9ae5ccd5173c52 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:20.481122 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:20.481609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:20.481609 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:20.502143 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:20.503384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:20.565429 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1447/2900] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:20.576932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:20.578642 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:20.601075 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:20.643568 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88cb9-620a-4910-90d8-491b7f5ebcd5 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:20.647572 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:20.648187 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:20.648465 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:20.648731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:20.658253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:20.659742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:20.669238 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1454/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:20.949443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:20.951082 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:20.965894 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed6474-76b6-4c03-90f8-3fea703e0477 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:20.971807 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:20.973389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:20.973389 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:20.973556 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] PATH_INFO: `/v3/projects/34e1ff4e9d6a46c3ab1b3b23cfdeb57d` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:20.974892 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e1ff4e9d6a46c3ab1b3b23cfdeb57d)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:20.976952 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:21.026269 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e1ff4e9d6a46c3ab1b3b23cfdeb57d', 'request_id': 'req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.035020 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e1ff4e9d6a46c3ab1b3b23cfdeb57d', 'request_id': 'req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.040783 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e1ff4e9d6a46c3ab1b3b23cfdeb57d', 'request_id': 'req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.051967 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] The token cache is being invalidate because project 34e1ff4e9d6a46c3ab1b3b23cfdeb57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:41:21.052253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.052914 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.054399 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1448/2902] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:41:20 2022] DELETE /identity/v3/projects/34e1ff4e9d6a46c3ab1b3b23cfdeb57d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:21.058652 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:21.068893 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c4a1a-45cb-442a-b2df-c8c473d0b4eb service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:21.125742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:21.126351 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:21.126619 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:21.126916 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] PATH_INFO: `/v3/users/4af76c412de74b908d4f744573040f64` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:21.128047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af76c412de74b908d4f744573040f64)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:21.129985 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:21.179283 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af76c412de74b908d4f744573040f64'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.187444 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af76c412de74b908d4f744573040f64'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.188072 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af76c412de74b908d4f744573040f64'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.188667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af76c412de74b908d4f744573040f64'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.196253 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af76c412de74b908d4f744573040f64'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.213489 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1455/2903] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:41:21 2022] DELETE /identity/v3/users/4af76c412de74b908d4f744573040f64 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:21.488775 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:21.490288 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:21.504175 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ff90-d187-45bf-a4e2-0a315cf7ae2c admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:21.561811 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:21.562404 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:21.562679 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:21.562982 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] PATH_INFO: `/v3/projects/5269f6044c4543ffa6ca23c9e71d54c4` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:21.564107 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5269f6044c4543ffa6ca23c9e71d54c4)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:21.566379 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:21.593742 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:21.625637 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5269f6044c4543ffa6ca23c9e71d54c4', 'request_id': 'req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.635387 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5269f6044c4543ffa6ca23c9e71d54c4', 'request_id': 'req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.642806 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5269f6044c4543ffa6ca23c9e71d54c4', 'request_id': 'req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.653991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] The token cache is being invalidate because project 5269f6044c4543ffa6ca23c9e71d54c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:41:21.654282 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.654987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.656579 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1449/2904] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:41:21 2022] DELETE /identity/v3/projects/5269f6044c4543ffa6ca23c9e71d54c4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:21.660660 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:21.662152 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:21.675289 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b9d88-54d6-411e-b1a7-630a7b4b0cae admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:21.717474 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:21.737627 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:21.738258 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:21.738535 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:21.738804 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] PATH_INFO: `/v3/users/385ddc60392e4cbf8774b583871b9933` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:21.739996 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=385ddc60392e4cbf8774b583871b9933)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:21.741938 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:21.796674 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385ddc60392e4cbf8774b583871b9933'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.803797 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385ddc60392e4cbf8774b583871b9933'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.804450 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385ddc60392e4cbf8774b583871b9933'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.805067 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385ddc60392e4cbf8774b583871b9933'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.812863 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-b067cf0f-1933-4fb0-9892-74c1804ecc3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385ddc60392e4cbf8774b583871b9933'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:21.830667 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1456/2905] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:41:21 2022] DELETE /identity/v3/users/385ddc60392e4cbf8774b583871b9933 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:22.108338 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.109833 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:22.131058 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3f94a-7dce-47b8-a24e-ff90e94ea97f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.194152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.194794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.195262 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.195532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] PATH_INFO: `/v3/projects/334455b4efb14b4399b82214e6ce3be8` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.196767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334455b4efb14b4399b82214e6ce3be8)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.198793 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.246887 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334455b4efb14b4399b82214e6ce3be8', 'request_id': 'req-952708bd-3d00-4c37-ba2b-dc2de5b4f708'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:22.256949 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334455b4efb14b4399b82214e6ce3be8', 'request_id': 'req-952708bd-3d00-4c37-ba2b-dc2de5b4f708'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:22.263549 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334455b4efb14b4399b82214e6ce3be8', 'request_id': 'req-952708bd-3d00-4c37-ba2b-dc2de5b4f708'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:22.276101 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] The token cache is being invalidate because project 334455b4efb14b4399b82214e6ce3be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:41:22.276384 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:22.277180 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-952708bd-3d00-4c37-ba2b-dc2de5b4f708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:41:22.278866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1450/2906] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:41:22 2022] DELETE /identity/v3/projects/334455b4efb14b4399b82214e6ce3be8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:22.285638 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6f62-633c-41f2-abb6-b6b65506137a None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.285920 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6f62-633c-41f2-abb6-b6b65506137a None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.286186 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6f62-633c-41f2-abb6-b6b65506137a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.307742 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-0fbb6f62-633c-41f2-abb6-b6b65506137a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:22.308962 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-0fbb6f62-633c-41f2-abb6-b6b65506137a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:22.378965 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1457/2907] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:22.388581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485fe17-34e1-407d-b9b4-7346db10a21a None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.388867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485fe17-34e1-407d-b9b4-7346db10a21a None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.389141 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485fe17-34e1-407d-b9b4-7346db10a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.410608 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-1485fe17-34e1-407d-b9b4-7346db10a21a None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:22.411867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-1485fe17-34e1-407d-b9b4-7346db10a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:22.421108 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1451/2908] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:22.425673 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb6f62-633c-41f2-abb6-b6b65506137a None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.435607 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb6f62-633c-41f2-abb6-b6b65506137a None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.440909 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.441507 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.441782 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.442058 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.442706 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:41:22.443046 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.444656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.456387 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1458/2909] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:41:22.460756 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485fe17-34e1-407d-b9b4-7346db10a21a None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.470246 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485fe17-34e1-407d-b9b4-7346db10a21a None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.476057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.476650 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.476925 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.477192 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.477818 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.479861 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.510199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1452/2910] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:41:22 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:22.514400 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.525141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930eb59-bb12-4d5d-a3e7-904b66e6c4db admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.572683 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:22.587969 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.588579 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.588923 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.589195 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.589836 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.591805 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.617426 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1459/2911] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:41:22 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:41:22.618768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.629633 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6744a-f3ac-443b-a6c4-669aef1be37f admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.634336 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.634981 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.635256 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.635524 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.636285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.637918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.643318 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:22.651856 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1453/2912] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:22.653182 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.663618 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b300c6-57f7-481b-bc88-0ccb43966167 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.669230 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774a3b-e491-410c-b119-ac95de5c9878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.669826 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774a3b-e491-410c-b119-ac95de5c9878 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.670101 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774a3b-e491-410c-b119-ac95de5c9878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.670370 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774a3b-e491-410c-b119-ac95de5c9878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.671056 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6774a3b-e491-410c-b119-ac95de5c9878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.672693 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6774a3b-e491-410c-b119-ac95de5c9878 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.683732 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1460/2913] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:41:22.688405 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.703267 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5489-b21c-4a80-acaf-adb200ae65f7 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.710499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.711507 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.711865 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.712291 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] PATH_INFO: `/v3/projects/67b48fad088a43ccaee8e6978494d188/users/8fdb631a8a864a4ca037abbbda4744f3/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.727848 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b48fad088a43ccaee8e6978494d188, user_id=8fdb631a8a864a4ca037abbbda4744f3, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.730503 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.747918 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1454/2914] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:41:22 2022] PUT /identity/v3/projects/67b48fad088a43ccaee8e6978494d188/users/8fdb631a8a864a4ca037abbbda4744f3/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:41:22.753118 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c8cb-9dd3-4646-9174-0ee150d48bf6 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.753406 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c8cb-9dd3-4646-9174-0ee150d48bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.753730 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c8cb-9dd3-4646-9174-0ee150d48bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.773047 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-af05c8cb-9dd3-4646-9174-0ee150d48bf6 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:22.774227 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-af05c8cb-9dd3-4646-9174-0ee150d48bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:22.835104 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1461/2915] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:22.844991 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:22.846964 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:22.903254 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b37fb-28b3-4f8c-88dc-b97b9cf0066e admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:22.907473 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:22.908080 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:22.908374 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:22.908612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:22.917709 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:22.919167 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:22.928496 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1455/2916] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 07:41:23.555435 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c718f0-0fe4-43b3-8d98-f3a49d5619bb None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:23.555932 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c718f0-0fe4-43b3-8d98-f3a49d5619bb None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:23.556202 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c718f0-0fe4-43b3-8d98-f3a49d5619bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:23.586816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-c3c718f0-0fe4-43b3-8d98-f3a49d5619bb None None] MFA Rules not processed for user `8fdb631a8a864a4ca037abbbda4744f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:23.588255 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-c3c718f0-0fe4-43b3-8d98-f3a49d5619bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:23.656419 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1462/2917] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 07:41:23.668145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:23.669581 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:23.727996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba639e60-65a2-4008-90f5-32818e45c4d7 service neutron] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:23.731845 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:23.732495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:23.732774 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:23.733046 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:23.741759 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:23.743255 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:23.752532 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1456/2918] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:25.118365 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfa3b1-9497-4cc2-8b8d-42d3ed348ff8 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:25.118952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfa3b1-9497-4cc2-8b8d-42d3ed348ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:25.118952 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfa3b1-9497-4cc2-8b8d-42d3ed348ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:25.140206 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-19cfa3b1-9497-4cc2-8b8d-42d3ed348ff8 None None] MFA Rules not processed for user `8fdb631a8a864a4ca037abbbda4744f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:25.141439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-19cfa3b1-9497-4cc2-8b8d-42d3ed348ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:25.150291 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1463/2919] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:28.512407 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:28.514499 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:28.590683 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efe593-e2ee-4aad-a706-3b2ce76435ab service cinder] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:28.597462 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:28.598231 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:28.598508 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:28.598779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:28.600878 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:28.614306 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:28.616079 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:28.627919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1457/2920] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:34.775534 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfa3b1-9497-4cc2-8b8d-42d3ed348ff8 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:34.789635 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfa3b1-9497-4cc2-8b8d-42d3ed348ff8 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:34.795243 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4bf83-a9d8-4852-a37a-98263afab88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded85d4044b1442d95e53c859459738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:34.795857 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4bf83-a9d8-4852-a37a-98263afab88d service nova] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:34.796134 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4bf83-a9d8-4852-a37a-98263afab88d service nova] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:34.796404 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4bf83-a9d8-4852-a37a-98263afab88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:34.798198 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-09d4bf83-a9d8-4852-a37a-98263afab88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:34.811021 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4bf83-a9d8-4852-a37a-98263afab88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:34.812596 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4bf83-a9d8-4852-a37a-98263afab88d service nova] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:34.823922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1464/2921] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:34.999394 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:35.009170 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188abf2-5928-4e7d-b6d3-65a084d74706 service nova] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:35.013528 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5c7a-7eda-46b8-8d5e-3a11b1a5e70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:35.014145 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5c7a-7eda-46b8-8d5e-3a11b1a5e70d service neutron] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:35.014422 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5c7a-7eda-46b8-8d5e-3a11b1a5e70d service neutron] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:35.014688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5c7a-7eda-46b8-8d5e-3a11b1a5e70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:35.016538 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-774a5c7a-7eda-46b8-8d5e-3a11b1a5e70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:35.022707 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:35.027781 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5c7a-7eda-46b8-8d5e-3a11b1a5e70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:35.029718 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5c7a-7eda-46b8-8d5e-3a11b1a5e70d service neutron] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:35.038253 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1458/2922] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:41:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:41:40.913307 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:40.913818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:40.913818 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:40.933691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] MFA Rules not processed for user `8fdb631a8a864a4ca037abbbda4744f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:40.934943 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:40.943542 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1465/2923] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:41:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:45.034480 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=3 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:50.928071 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:56.800476 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fdcca-7f8e-4bc8-9a7d-4bf10ac3a58e None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:56.800983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fdcca-7f8e-4bc8-9a7d-4bf10ac3a58e None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:56.800983 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fdcca-7f8e-4bc8-9a7d-4bf10ac3a58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:56.857767 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-435fdcca-7f8e-4bc8-9a7d-4bf10ac3a58e None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:41:56.859036 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-435fdcca-7f8e-4bc8-9a7d-4bf10ac3a58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:56.924237 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1459/2924] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 15 07:41:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:41:56.972720 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:41:56.974240 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:41:57.066840 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0362e4-37dd-49dc-a27f-8e81e584573f None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:41:57.072472 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:41:57.073057 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:41:57.073334 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:41:57.073612 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:41:57.081656 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:41:57.083290 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:41:57.091108 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1466/2925] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:41:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:42:06.920970 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=40 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:07.088063 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=41 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:11.435455 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:11.435919 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:11.436029 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:11.456275 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] MFA Rules not processed for user `77673f0ca55f4eeb9fbee6d9c48dc4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:42:11.457460 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:11.465178 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1460/2926] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 15 07:42:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:42:11.480491 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:11.491620 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288afe6-2c98-4865-a06a-2233e8a52cf3 service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:11.497661 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '263fc62721954c23b0357d9e45447713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:11.498265 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:11.498541 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:11.498806 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:11.507094 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:11.508699 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:11.516839 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1467/2927] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 15 07:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 07:42:13.399745 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:13.401222 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:13.477459 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:13.482444 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac06bb-85a4-40fb-98a8-f60c6ccacab8 None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:13.487786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:13.488416 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:13.488728 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c412-c9c9-4f88-b037-f533599d5f5c service swift] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:13.488864 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:13.489137 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:13.491017 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:13.493249 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:13.493861 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:13.494133 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:13.494398 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] PATH_INFO: `/v3/users/8fdb631a8a864a4ca037abbbda4744f3` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:13.495533 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdb631a8a864a4ca037abbbda4744f3)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:13.497439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:13.503224 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:13.504795 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:13.516881 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1461/2928] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:42:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:42:13.547078 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdb631a8a864a4ca037abbbda4744f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.555543 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdb631a8a864a4ca037abbbda4744f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.556503 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdb631a8a864a4ca037abbbda4744f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.557191 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdb631a8a864a4ca037abbbda4744f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.565141 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-04c31adb-7b67-4189-9ab2-20e1b0793902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdb631a8a864a4ca037abbbda4744f3'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.582395 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1468/2929] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:42:13 2022] DELETE /identity/v3/users/8fdb631a8a864a4ca037abbbda4744f3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:42:13.762859 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:13.774317 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd5756-e324-45f1-9678-1e6fa47582a8 service placement] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:13.830513 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:13.831169 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:13.831443 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:13.831689 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] PATH_INFO: `/v3/projects/67b48fad088a43ccaee8e6978494d188` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:13.832836 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b48fad088a43ccaee8e6978494d188)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:13.834735 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:13.882129 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b48fad088a43ccaee8e6978494d188', 'request_id': 'req-4c7900cf-f29a-442b-8465-b57c068cd4e3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.889341 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b48fad088a43ccaee8e6978494d188', 'request_id': 'req-4c7900cf-f29a-442b-8465-b57c068cd4e3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.895091 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b48fad088a43ccaee8e6978494d188', 'request_id': 'req-4c7900cf-f29a-442b-8465-b57c068cd4e3'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.905901 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] The token cache is being invalidate because project 67b48fad088a43ccaee8e6978494d188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:42:13.906199 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.906794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-4c7900cf-f29a-442b-8465-b57c068cd4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:13.908289 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1462/2930] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:42:13 2022] DELETE /identity/v3/projects/67b48fad088a43ccaee8e6978494d188 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:42:13.913329 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960e9e8-4efc-4e33-8e48-d51a3a8cbf31 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:13.913597 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960e9e8-4efc-4e33-8e48-d51a3a8cbf31 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:13.913866 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960e9e8-4efc-4e33-8e48-d51a3a8cbf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:13.934593 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-a960e9e8-4efc-4e33-8e48-d51a3a8cbf31 None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:42:13.935846 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-a960e9e8-4efc-4e33-8e48-d51a3a8cbf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:13.996712 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1469/2931] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:42:14.004309 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604a5c-3972-4014-9ff6-fc3cad98d01d None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.004569 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604a5c-3972-4014-9ff6-fc3cad98d01d None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.004850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604a5c-3972-4014-9ff6-fc3cad98d01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.026074 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-2b604a5c-3972-4014-9ff6-fc3cad98d01d None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:42:14.027240 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-2b604a5c-3972-4014-9ff6-fc3cad98d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:14.035393 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1463/2932] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:42:14.040026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960e9e8-4efc-4e33-8e48-d51a3a8cbf31 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:14.051691 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960e9e8-4efc-4e33-8e48-d51a3a8cbf31 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:14.059455 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:14.060092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.060366 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.060633 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.061282 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 07:42:14.061580 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:14.063219 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:14.075483 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1470/2933] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 15 07:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 07:42:14.079768 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b604a5c-3972-4014-9ff6-fc3cad98d01d None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:14.088867 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b604a5c-3972-4014-9ff6-fc3cad98d01d None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:14.093757 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:14.094346 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.094619 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.094924 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.095552 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:14.097430 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:14.102116 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:14.133618 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1464/2934] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 15 07:42:14 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 07:42:14.137875 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:14.147767 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589630cb-1236-4a6e-95a3-e374f954f1ec admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:14.191885 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:14.207731 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:14.208344 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.208623 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.208895 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.209540 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:14.211585 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:14.234527 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1471/2935] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 15 07:42:14 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 07:42:14.238744 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:14.249186 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa950ee-13e9-401e-84ec-ebcd586f6fbf admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:14.254675 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:14.255312 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.255588 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.255850 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.256490 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:14.258226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:14.269144 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1465/2936] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 07:42:14.273064 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:14.283324 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd69c1-f336-4ee4-96d8-db2c14827ca3 admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:14.288333 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276124f0-757d-4137-b799-b9e22c1b73e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:14.288991 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276124f0-757d-4137-b799-b9e22c1b73e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.289270 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276124f0-757d-4137-b799-b9e22c1b73e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.289539 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276124f0-757d-4137-b799-b9e22c1b73e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.290184 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276124f0-757d-4137-b799-b9e22c1b73e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:14.291820 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276124f0-757d-4137-b799-b9e22c1b73e9 admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:14.302544 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1472/2937] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 15 07:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 07:42:14.306653 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:14.317106 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f2c60-8033-4aee-8f4b-c47d1628d629 admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:14.322226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:14.322872 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.323173 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.323469 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] PATH_INFO: `/v3/projects/a155b53a0eee417f814203dc73807476/users/696a679e051e499d900217ee62741ff6/roles/b4bb394dff344761ba3dfd2d3be54ad7` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.339119 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a155b53a0eee417f814203dc73807476, user_id=696a679e051e499d900217ee62741ff6, role_id=b4bb394dff344761ba3dfd2d3be54ad7)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:14.341779 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:14.357629 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1466/2938] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 15 07:42:14 2022] PUT /identity/v3/projects/a155b53a0eee417f814203dc73807476/users/696a679e051e499d900217ee62741ff6/roles/b4bb394dff344761ba3dfd2d3be54ad7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 07:42:14.368942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bfdd-ed09-4789-a09f-d1ee376a5c65 None None] REQUEST_METHOD: `POST` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.369226 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bfdd-ed09-4789-a09f-d1ee376a5c65 None None] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.369490 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bfdd-ed09-4789-a09f-d1ee376a5c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.397902 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.auth.core [None req-96a6bfdd-ed09-4789-a09f-d1ee376a5c65 None None] MFA Rules not processed for user `696a679e051e499d900217ee62741ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:42:14.399143 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-96a6bfdd-ed09-4789-a09f-d1ee376a5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:14.467020 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1473/2939] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:42:14.478816 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:14.480786 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:14.537978 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1615-008b-44ce-b3d5-495697ec56fb admin admin] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:14.542285 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa8210-2fc2-4586-a88f-d265b1bfe9c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc638eccee04ac6a71972e255947aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:14.542969 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8210-2fc2-4586-a88f-d265b1bfe9c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:14.543228 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8210-2fc2-4586-a88f-d265b1bfe9c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:14.543495 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8210-2fc2-4586-a88f-d265b1bfe9c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:14.553401 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa8210-2fc2-4586-a88f-d265b1bfe9c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:14.554996 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa8210-2fc2-4586-a88f-d265b1bfe9c2 service cinder] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:14.564577 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1467/2940] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:42:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:42:24.463922 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:24.559907 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:45.905710 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6bfdd-ed09-4789-a09f-d1ee376a5c65 None None] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:45.970467 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6bfdd-ed09-4789-a09f-d1ee376a5c65 None None] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:45.975816 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:45.976412 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:45.976681 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:45.976942 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] PATH_INFO: `/v3/users/696a679e051e499d900217ee62741ff6` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:45.978171 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=696a679e051e499d900217ee62741ff6)` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:45.980156 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:46.041549 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696a679e051e499d900217ee62741ff6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.050028 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696a679e051e499d900217ee62741ff6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.050860 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696a679e051e499d900217ee62741ff6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.052099 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696a679e051e499d900217ee62741ff6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.060209 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.notifications [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696a679e051e499d900217ee62741ff6'} {{(pid=81431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.080640 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1474/2941] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 15 07:42:45 2022] DELETE /identity/v3/users/696a679e051e499d900217ee62741ff6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:42:46.086184 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] REQUEST_METHOD: `POST` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:46.086688 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:46.086794 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:46.107772 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.auth.core [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] MFA Rules not processed for user `d29816653d6248568ba7209d83b507fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 07:42:46.109057 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:46.171115 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1468/2942] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 15 07:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 07:42:46.181154 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:46.182793 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:46.241510 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc05b9-d0fb-420f-9afa-598fe5e7e07a admin admin] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:46.245439 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075b856-f64d-411b-8052-47499311574e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9308f360df864174967889252718bc10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:46.246077 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b856-f64d-411b-8052-47499311574e service neutron] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:46.246379 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b856-f64d-411b-8052-47499311574e service neutron] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:46.246646 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b856-f64d-411b-8052-47499311574e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:46.255787 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075b856-f64d-411b-8052-47499311574e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:46.257231 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075b856-f64d-411b-8052-47499311574e service neutron] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:46.266835 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1475/2943] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:42:46.544223 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] Authenticating user token {{(pid=81430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:42:46.545947 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.fernet_utils [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:42:46.561454 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b0f4-163d-4074-b5fb-461768fc95ed None None] Validating token access rules against request {{(pid=81430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:42:46.567491 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29816653d6248568ba7209d83b507fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7faaeb98831242a0b51ad3154e077405', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:42:46.568659 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:42:46.568763 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] SCRIPT_NAME: `/identity` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:42:46.568987 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] PATH_INFO: `/v3/projects/a155b53a0eee417f814203dc73807476` {{(pid=81430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:42:46.570152 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a155b53a0eee417f814203dc73807476)` {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:42:46.572226 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] RBAC: Authorization granted {{(pid=81430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:42:46.620950 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a155b53a0eee417f814203dc73807476', 'request_id': 'req-df1080e5-75d5-4056-90d0-49dd319b660c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.629989 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a155b53a0eee417f814203dc73807476', 'request_id': 'req-df1080e5-75d5-4056-90d0-49dd319b660c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.635831 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a155b53a0eee417f814203dc73807476', 'request_id': 'req-df1080e5-75d5-4056-90d0-49dd319b660c'} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.647000 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] The token cache is being invalidate because project a155b53a0eee417f814203dc73807476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 07:42:46.647292 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.647999 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG keystone.notifications [None req-df1080e5-75d5-4056-90d0-49dd319b660c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 07:42:46.649612 dv-cinder-824149-6-smb devstack@keystone.service[81430]: [pid: 81430|app: 0|req: 1469/2944] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 15 07:42:46 2022] DELETE /identity/v3/projects/a155b53a0eee417f814203dc73807476 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 07:42:56.263026 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:56.643866 dv-cinder-824149-6-smb devstack@keystone.service[81430]: DEBUG dbcounter [-] [81430] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:36.920284 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075b856-f64d-411b-8052-47499311574e service neutron] Authenticating user token {{(pid=81431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 07:43:36.922554 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-6075b856-f64d-411b-8052-47499311574e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:43:36.999212 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075b856-f64d-411b-8052-47499311574e service neutron] Validating token access rules against request {{(pid=81431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 07:43:37.060482 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42259cf-fa4e-4b52-9406-c3e1a3c66166 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cd8870330414fddaca7b5d2075b4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee28b0a5c2f84d3c8d7ed171da908321', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 07:43:37.061092 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42259cf-fa4e-4b52-9406-c3e1a3c66166 service placement] REQUEST_METHOD: `GET` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 07:43:37.061369 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42259cf-fa4e-4b52-9406-c3e1a3c66166 service placement] SCRIPT_NAME: `/identity` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 07:43:37.062001 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42259cf-fa4e-4b52-9406-c3e1a3c66166 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 07:43:37.063927 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.fernet_utils [None req-d42259cf-fa4e-4b52-9406-c3e1a3c66166 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 07:43:37.075312 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42259cf-fa4e-4b52-9406-c3e1a3c66166 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 07:43:37.076888 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42259cf-fa4e-4b52-9406-c3e1a3c66166 service placement] RBAC: Authorization granted {{(pid=81431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 07:43:37.086901 dv-cinder-824149-6-smb devstack@keystone.service[81431]: [pid: 81431|app: 0|req: 1476/2945] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 15 07:43:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 07:43:47.082974 dv-cinder-824149-6-smb devstack@keystone.service[81431]: DEBUG dbcounter [-] [81431] Writing DB stats keystone:SELECT=58 {{(pid=81431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}